-- Logs begin at Wed 2022-08-03 12:08:41 UTC, end at Wed 2022-08-03 13:27:10 UTC. -- Aug 03 12:50:20.929249 dv-cinder-850836-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 03 12:50:20.938551 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 03 12:50:20.940552 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 3 12:50:20 2022] *** Aug 03 12:50:20.940552 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 03 12:50:20.940552 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 03 12:50:20.940552 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: nodename: dv-cinder-850836-4-iscsi Aug 03 12:50:20.940552 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: machine: x86_64 Aug 03 12:50:20.940552 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: clock source: unix Aug 03 12:50:20.940552 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: pcre jit disabled Aug 03 12:50:20.940552 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: detected number of CPU cores: 4 Aug 03 12:50:20.940552 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: current working directory: / Aug 03 12:50:20.940552 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: detected binary path: /usr/bin/uwsgi-core Aug 03 12:50:20.940552 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: your processes number limit is 47680 Aug 03 12:50:20.941313 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: your memory page size is 4096 bytes Aug 03 12:50:20.941313 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: detected max file descriptor number: 2048 Aug 03 12:50:20.941313 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: lock engine: pthread robust mutexes Aug 03 12:50:20.941313 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: thunder lock: enabled Aug 03 12:50:20.941313 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 03 12:50:20.941313 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 03 12:50:20.979842 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: Python main interpreter initialized at 0x5581e283f9c0 Aug 03 12:50:20.979842 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: python threads support enabled Aug 03 12:50:20.979842 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: your server socket listen backlog is limited to 100 connections Aug 03 12:50:20.979842 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: your mercy for graceful operations on workers is 90 seconds Aug 03 12:50:20.980163 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: mapped 403077 bytes (393 KB) for 2 cores Aug 03 12:50:20.980243 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: *** Operational MODE: preforking *** Aug 03 12:50:20.980500 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: *** uWSGI is running in multiple interpreter mode *** Aug 03 12:50:20.980500 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: spawned uWSGI master process (pid: 104418) Aug 03 12:50:20.980678 dv-cinder-850836-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 03 12:50:20.982523 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: spawned uWSGI worker 1 (pid: 104419, cores: 1) Aug 03 12:50:20.982523 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: spawned uWSGI worker 2 (pid: 104420, cores: 1) Aug 03 12:50:20.982523 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 03 12:50:21.640291 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 12:50:21.643012 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 12:50:22.719319 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 12:50:22.719319 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: from cryptography.utils import int_from_bytes Aug 03 12:50:22.719921 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 12:50:22.719921 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: from cryptography.utils import int_from_bytes Aug 03 12:50:22.727643 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 12:50:22.727643 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: from cryptography.utils import int_from_bytes Aug 03 12:50:22.728072 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 12:50:22.728072 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: from cryptography.utils import int_from_bytes Aug 03 12:50:25.210465 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 12:50:25.210985 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 12:50:25.211261 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 12:50:25.211621 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 12:50:25.211875 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 12:50:25.212257 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.212578 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.212902 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.213052 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 12:50:25.213453 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 12:50:25.213546 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.213546 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.213712 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 12:50:25.213825 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.214020 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 12:50:25.214139 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.214280 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 12:50:25.214454 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.214668 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.214789 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.215023 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.215120 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.215346 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.215432 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.215664 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.215756 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850836-4-iscsi {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.215979 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.216075 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.216324 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.216665 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.217006 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.217340 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.217605 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.217923 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.218218 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.218318 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850836-4-iscsi {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.218539 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.218626 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.218882 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.218971 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.219191 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.219276 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.219510 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.219593 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.219813 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.219897 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.220134 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.220308 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.220695 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.220827 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.220935 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.221068 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.221221 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.221341 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.221514 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.221635 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.221835 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.221943 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.222168 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.222261 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.222483 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.222576 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.222832 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.222938 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.223158 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.223256 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.223468 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.223561 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.223797 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.223884 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850836-4-iscsi {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.224109 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.224208 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.224459 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.224539 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850836-4-iscsi {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.224771 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.224863 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.225113 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.225204 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.225429 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.225522 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.225768 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.225895 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.226087 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.226179 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.226421 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.226508 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.226740 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.226841 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.227074 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.227161 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.227397 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.227493 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.227715 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.227810 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.228034 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.228124 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.228335 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.228430 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.228643 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.228729 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.228952 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.229051 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.229262 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.229355 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.229564 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.229655 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.229868 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.229953 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.230116 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.230284 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.230421 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.230513 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.230716 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.230838 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.231054 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.231142 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.231376 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.231470 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.231646 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.231745 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.231900 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.232029 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.232216 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.232366 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.232519 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.232665 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.232811 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.232965 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.233103 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.233255 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.233404 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.233491 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.233706 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.233796 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.234008 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.234095 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.234310 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.234405 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.234611 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.234708 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.234938 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.235039 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.235256 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.235343 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.235562 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.235654 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.235878 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.235968 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.236181 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.236275 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.236496 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.236581 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.236804 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.236888 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.237121 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.237206 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.237433 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.237519 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.237756 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.237848 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.238067 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.238152 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.238370 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.238462 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.238686 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.238820 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.239029 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.239115 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.239334 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.239427 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.239638 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.239732 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.239942 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.240084 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.240250 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.240334 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.240560 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.240655 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.240863 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.240948 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.241113 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.241198 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.241411 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.241504 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.241715 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.241806 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.242030 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.242143 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.242333 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.242444 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.242637 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.242765 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.242965 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.243069 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.243265 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.243366 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.243569 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.243654 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.243871 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.243959 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.244173 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.244258 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.244476 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.244562 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.244779 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.244864 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.245082 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.245175 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.245386 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.245482 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.245687 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.245782 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.245989 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.246081 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.246294 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.246378 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.246602 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.246704 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.246928 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.247014 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.247724 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.247820 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.248049 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.248151 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.248351 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.248443 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.248667 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.248760 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.248969 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.249063 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.249272 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.249365 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.249586 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.249670 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.249886 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.249987 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.250187 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.250272 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.250500 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.250585 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.250825 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.250927 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.251130 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.251222 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.251447 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.251564 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.251746 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.251853 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.252051 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.252151 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.252353 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.252441 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.252654 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.252761 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.252954 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.253041 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.253253 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.253362 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.253556 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.253655 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.253854 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.253960 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.254154 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.254241 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.254452 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.254539 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.254767 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.254856 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.255069 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.255157 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.255375 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.255461 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.255676 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.255783 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.255985 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.256078 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.256289 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.256377 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.256592 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.256679 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.256901 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.257063 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.257209 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.257302 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.257538 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:25.257623 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.257876 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.257971 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.258189 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.258273 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.258522 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.258608 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.258876 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.258987 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.259194 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.259279 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.259507 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.259601 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.259820 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.259910 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.260146 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.260232 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.260457 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.260545 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.260767 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.260854 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.261076 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.261163 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.261390 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.261481 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.261707 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.261802 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.262028 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.262135 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.262343 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.262446 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.262658 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.262771 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.263562 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.263719 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.263880 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.264013 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.264200 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.264297 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.264515 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.264601 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.264837 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.264923 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.265148 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.265235 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.265480 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.265564 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.265797 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.265890 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.266116 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.266202 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.266439 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.266526 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.266779 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.266901 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.267094 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.267198 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.267404 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.267527 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.267712 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.267824 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.268031 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.268118 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.268344 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.268431 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.268659 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.268753 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.268976 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.269064 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.269285 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.269379 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.269596 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.269691 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.269905 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.269999 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.270213 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.270299 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.270523 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.270617 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.270860 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.270949 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.271176 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.271264 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.271487 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.271574 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.271800 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.271895 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.272112 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.272199 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.272421 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.272509 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.272731 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.272818 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.273041 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.273202 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.273343 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.273444 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.273645 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.273790 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.273947 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.274097 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.274251 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.274344 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.274548 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.274632 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.274882 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.274985 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.275191 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.275278 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.275502 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.275586 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.275830 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.275924 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.276138 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.276294 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.276431 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.276568 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.276740 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.276884 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.277041 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.277178 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.277338 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.277484 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.277649 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.277782 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.277958 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.278087 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.278259 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.278389 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.279150 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.279290 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.279466 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.279599 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.279772 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.279909 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.280095 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.280228 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.280399 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.280531 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.280704 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.280835 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.281047 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.281184 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.281320 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.281454 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.281598 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.281775 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.281921 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.282074 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.282211 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.282345 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.282524 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.282626 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.282813 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.282913 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.283123 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.283217 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.283453 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.283548 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.283770 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.283915 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.284088 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.284220 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.284394 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.284489 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.284718 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.284803 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.285031 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.285115 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.285333 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.285420 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.285641 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.285728 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.285943 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.286040 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.286244 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.286331 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.286546 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.286639 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.286876 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.286966 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.287178 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.287265 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.287744 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.287836 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.288052 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.288138 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.288350 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.288436 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.288650 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.288735 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.288953 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.289047 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.289257 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.289343 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.289555 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.289639 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.289860 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.289998 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.290174 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.290276 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.290468 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.290563 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.290795 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.290906 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.291135 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.291231 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.291440 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.291588 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.291770 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.291914 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.292092 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.292235 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.292402 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.292536 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.292719 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.292854 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.293028 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.293168 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.293339 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.293473 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.293647 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.293786 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.293943 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.294088 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.294835 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.294926 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.295142 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.295232 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.295462 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.295548 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.295770 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.295856 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.296093 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.296182 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.296401 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.296487 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.296718 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.296811 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.297019 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.297114 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.297334 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.297420 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.297659 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.297754 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.297983 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.298069 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.298296 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.298389 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.298615 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.298710 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.298947 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.299049 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.299263 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.299357 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.299571 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.299667 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.299881 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.299978 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.300189 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.300283 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.300497 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.300597 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.300815 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.300900 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.301119 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.301202 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.301437 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.301531 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.301743 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.301829 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.302062 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.302153 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.302371 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.302466 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.302687 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.302798 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.303012 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.303101 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.303324 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.303412 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.303628 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.303713 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.303949 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.304044 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.304259 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.304349 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.304568 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.304663 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.304887 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.305019 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.305197 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.305286 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.305504 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.305601 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.305812 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.305908 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.306115 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.306202 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.306417 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.306504 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.306723 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.306842 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.307055 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.307142 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.307361 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.307453 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.307667 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.307768 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.307974 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.308060 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.308284 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.308369 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.308587 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.308681 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.308889 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.308976 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.309192 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.309277 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.309502 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.309598 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.309837 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.309930 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.310147 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.310232 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.310467 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.310565 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.310801 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.310891 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.311108 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.311195 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.311410 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.311498 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.311730 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.311817 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.312036 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.312133 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.312338 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.312425 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.312641 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.312728 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.312944 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.313044 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.313251 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.313340 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.313561 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.313656 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.313866 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.313960 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.314179 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.314266 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.314497 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.314584 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.314829 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.314936 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.315146 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.315243 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.315453 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.315541 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.315760 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.315861 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.316071 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.316157 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.316378 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.316463 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.316684 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.316779 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.316993 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.317079 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.317299 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.317393 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.317605 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.317700 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.317915 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.318001 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.318231 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.318317 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.318534 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.318621 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.318870 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.318961 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.319179 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.319267 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.319480 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.319568 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.319787 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.319873 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.320091 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.320183 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.320405 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.320656 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.320751 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.320987 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.321279 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.321376 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.321603 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.321688 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.321918 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.322004 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.322233 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.322338 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.322552 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.322636 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.322900 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.322988 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.323234 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.323341 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.323539 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.323627 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.323848 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.323941 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.324151 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.324249 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.324453 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.324552 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.324760 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.324847 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.325060 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.325192 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.325381 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.325478 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.325687 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.325780 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.325993 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.326078 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.326291 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.326385 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.326592 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.326680 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.326917 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.327006 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.327220 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.327309 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.327532 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.327617 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.327837 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.327921 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.328145 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.328240 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.328445 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.328531 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.328755 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.328843 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.329058 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.329152 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.329359 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.329452 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.329660 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.329746 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.329962 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.330049 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.330264 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.330348 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.330571 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.330666 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.330937 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.331025 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.331244 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.331329 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.331586 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.331682 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.331888 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.331975 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.332190 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.332277 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.332510 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.332605 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.332811 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.332900 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.333113 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.333208 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.333412 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.333517 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.333717 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.333805 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.334022 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.334109 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.334322 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.334409 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.334628 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.334718 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.334958 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.335055 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.335264 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.335352 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.335569 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.335657 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.335867 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.335953 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.336172 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.336260 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.336470 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.336563 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.336778 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.336862 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.337081 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.337169 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.337381 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.337467 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.337678 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.337777 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.337985 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.338071 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.338287 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.338372 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.338588 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.338687 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.338921 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.339023 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.339221 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.339315 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.339531 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.339625 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.339828 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.339912 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.340147 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.340249 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.340424 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.340521 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.340728 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.340812 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.341563 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.341657 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.341940 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.342071 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.342180 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.342312 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.342472 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.342558 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.342793 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.342895 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.343096 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.343182 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.343403 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.343488 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.343702 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.343789 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.344002 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.344087 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.344307 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.344395 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.344610 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.344705 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.344922 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.345008 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.345223 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.345319 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.345529 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.345633 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.345829 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.345916 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.346129 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.346224 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.346429 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.346516 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.346750 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.346839 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.347053 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.347154 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.347354 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.347440 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.347653 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.347740 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.347952 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.348048 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.348251 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.348337 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.348553 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.348638 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.348856 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.348991 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.349155 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.349241 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.349456 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.349541 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.349757 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.349844 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.350065 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.350149 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.350370 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.350455 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.350716 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.350861 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.351041 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.351126 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.351352 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.351438 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.351670 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.351766 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.351981 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.352067 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.352288 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.352387 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.352598 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.352684 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.352896 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.352980 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.353207 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.353301 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.353511 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.353597 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.353818 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.353910 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.354119 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.354215 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.354419 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.354505 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.354723 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.354829 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.355057 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.355155 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.355366 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.355491 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.355677 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.355831 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.355991 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.356087 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.356310 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.356404 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.356631 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.357310 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.357452 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.357555 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.357757 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.357845 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.358064 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.358151 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.358378 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.358466 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.358686 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.358810 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.359025 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.359113 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.359338 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.359426 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.359650 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.359735 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.359962 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.360048 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.360266 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.360359 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.360569 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.360655 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.360877 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.360971 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.361182 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.361268 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.361480 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.361573 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.361790 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.361885 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.362097 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.362183 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.362398 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.362484 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.362708 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.362874 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.363031 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.363119 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.363340 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.363425 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.363640 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.363801 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.363954 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.364047 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.364261 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.364348 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.364650 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.364736 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.364952 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.365046 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.365261 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.365347 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.365571 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.365666 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.365883 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.365968 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.366191 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.366276 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.366491 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.366579 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.366835 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.366926 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.367148 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.367237 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.367528 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.367616 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.367837 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.367926 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.368140 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.368236 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.368448 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.368535 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.368756 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.368844 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.369060 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.369205 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.369364 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.369458 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.369663 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.369750 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.369963 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.370059 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.370268 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.370353 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.370569 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.370654 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.370910 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.371012 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.371217 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.371323 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.371542 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.371629 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.371920 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.372007 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.372281 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.372376 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.372589 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.372677 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.372942 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.373029 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.373260 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.373346 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.373581 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.373677 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.373900 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.373992 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.374204 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.374300 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.374513 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.374624 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.374849 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.374935 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.375154 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.375242 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.375466 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.375553 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.375776 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.375870 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.376088 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.376194 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.376388 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.376476 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.376704 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.376804 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.377010 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.377098 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.377318 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.377404 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.377636 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.377731 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.377956 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.378043 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.378280 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.378366 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.378659 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.378775 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.379006 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.379105 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.379334 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.379431 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.379639 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.379727 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.379942 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.380030 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.380250 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.380337 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.380553 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.380642 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.380857 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.380943 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.381161 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.381246 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.381467 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.381562 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.381775 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.381860 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.382084 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.382177 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.382389 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.382475 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.382692 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.382828 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.383017 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.383208 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.383527 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.383601 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.383668 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.383734 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.383964 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.384077 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.384223 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.384311 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.384543 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.384628 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.384855 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.384949 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.385157 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.385243 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.385475 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.385562 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.385784 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.385878 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.386083 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.386169 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.386385 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.386481 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.386688 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.386809 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.387022 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.387109 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.387331 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.387426 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.387648 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.387742 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.388001 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.388090 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.388326 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.388413 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.388636 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.388723 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.388967 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.389054 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.389281 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.389421 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.389591 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.389695 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.389905 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.389993 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.390229 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.390335 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.390532 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.390628 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.390857 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.390950 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.391168 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.391266 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.391470 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.391559 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.391771 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.391867 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.392072 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.392167 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.392377 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.392471 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.392675 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.392764 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.392975 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.393072 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.393276 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.393363 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.393579 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.393712 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.393883 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.393972 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.394200 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.394287 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.394505 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.394598 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.394825 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.394926 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.395128 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.395223 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.395430 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.395524 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.395752 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.395848 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.396056 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.396151 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.396379 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.396466 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.396686 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.396775 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.397004 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.397099 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.397313 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.397411 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.397624 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.397709 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.397936 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.398030 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.398248 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.398347 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.398563 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.398657 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.398899 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.398989 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.399210 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.399308 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.399516 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.399612 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.399828 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.399913 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.400140 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.400234 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.400450 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.400535 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.400768 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.400967 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.401088 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.401290 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.401601 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.401686 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.401909 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.401997 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.402217 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.402306 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.402527 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.402613 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.402859 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.402951 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.403169 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.403259 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.403969 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.404101 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.404292 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.404380 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.404601 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.404690 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.404956 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.405050 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.405229 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.405327 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.405548 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.405634 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.405875 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.405956 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.406187 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.406301 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.406499 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.406586 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.406847 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.406938 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.407160 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.407257 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.407477 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.407563 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.407804 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.407892 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.408104 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.408191 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.408420 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.408506 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.408730 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.408826 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.409038 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.409133 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.409345 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.409432 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.409654 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.409761 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.409963 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.410058 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.410272 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.410358 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.410579 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.410676 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.410911 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.411003 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.411222 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.411310 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.411534 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.411621 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.411852 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.411947 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.412170 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.412265 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.412755 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.412857 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.413069 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.413156 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.413379 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.413465 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.413692 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.413797 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.414007 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.414210 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.414326 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.414524 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.414876 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.414967 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.415196 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.415283 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.415516 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.415620 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.415829 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.415916 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.416144 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.416229 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.416463 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.416558 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.416764 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.416850 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.417067 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.417153 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.417375 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.417472 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.417683 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.417770 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.417983 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.418077 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.418297 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.418385 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.418603 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.418697 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.418930 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.419020 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.419807 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.419911 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.420118 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.420205 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.420442 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.420679 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.420776 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.421020 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.421278 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.421365 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.421625 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.421711 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.421943 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.422032 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.422254 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.422339 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.422559 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.422654 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.422904 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.422993 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.423209 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.423307 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.423512 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.423609 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.423829 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.423950 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.424134 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.424248 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.424436 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.424580 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.424738 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.424825 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.425046 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.425131 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.425351 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.425447 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.425654 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.425741 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.425962 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.426048 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.426263 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.426404 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.426573 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.426714 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.426899 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.426990 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.427204 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.427302 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.427508 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.427603 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.427817 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.427905 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.428120 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.428215 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.428428 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.428514 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.428730 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.428818 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.429029 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.429117 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.429337 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.429430 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.429634 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.429732 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.429939 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.430026 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.430239 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.430332 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.430546 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.430641 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.430876 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.430966 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.431182 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.431267 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.431484 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.431582 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.431796 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.431881 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.432096 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.432181 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.432420 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.432517 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.432729 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.432817 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.433035 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.433132 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.433355 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.433445 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.433664 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.433758 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.433971 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.434059 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.434299 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.434385 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.434619 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.434748 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.435012 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.435215 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.435336 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.435558 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.435880 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.435969 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.436232 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.436318 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.436539 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.436634 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.436844 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.436929 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.437153 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.437250 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.437459 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.437554 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.437786 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.437873 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.438092 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.438186 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.438406 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.438490 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.438721 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.438835 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.439052 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.439154 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.439363 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.439448 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.439673 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.439758 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.439988 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.440151 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.440307 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.440448 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.440587 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.440734 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.440885 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.441013 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.441183 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.441323 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.441492 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.441630 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.441800 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.441941 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.442108 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.442243 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.442420 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.442562 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.442766 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.442859 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.443075 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.443170 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.443388 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.443492 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.443703 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.443794 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.444022 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.444110 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.444332 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.444428 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.444642 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.444740 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.444950 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.445036 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.445257 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.445354 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.445566 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.445652 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.445878 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.445964 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.446194 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.446288 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.446503 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.446609 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.446851 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.446955 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.447165 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.447261 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.447540 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.447625 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.447858 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.447952 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.448171 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.448260 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.448500 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.448586 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.448812 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.448907 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.449119 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.449206 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.449439 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.449748 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.450074 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.450473 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.450837 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.451168 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.451255 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.451488 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.451577 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.451828 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.451916 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.452173 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.452261 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.452479 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.452574 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.452788 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.452876 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.453104 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.453191 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.453417 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.453512 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.453728 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.453815 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.454031 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.454123 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.454336 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.454433 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.454646 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.454822 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.454976 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.455064 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.455282 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.455382 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.455585 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.455679 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.455890 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.455978 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.456195 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.456290 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.456507 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.456640 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.456800 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.456887 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.457103 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.457192 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.457406 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.457507 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.457709 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.457796 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.458009 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.458105 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.458313 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.458399 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.458612 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.458698 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.458943 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.459034 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.459246 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.459332 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.459545 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.459641 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.459846 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.459934 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.460152 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.460289 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.460461 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.460557 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.460767 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.460854 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.461101 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.461187 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.461408 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.461502 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.461727 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.461816 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.462038 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.462125 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.462350 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.462437 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.462667 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.462771 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.463008 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.463106 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.463317 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.463408 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.463645 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.463731 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.463955 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.464054 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.464266 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.464354 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.464574 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.464659 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.464883 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.464970 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.465206 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.465305 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.465501 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.465587 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.465813 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.465910 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.466643 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.466767 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.466973 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.467059 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.467298 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.467396 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.467618 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.467705 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.467926 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.468023 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.468241 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.468336 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.468550 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.468637 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.468873 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.468959 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.469183 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.469278 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.469498 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.469586 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.469806 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.469900 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.470115 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.470206 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.470424 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.470528 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.470755 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.470845 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.471062 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.471150 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.471370 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.471456 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.471684 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.471779 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.471995 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.472081 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.472310 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.472412 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.472629 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.472725 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.472936 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.473022 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.473261 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.473348 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.473586 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.473686 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.473898 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.473984 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.474228 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.474314 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.474559 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.474659 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.474906 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.475034 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.475220 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.475373 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.475530 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.475627 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.475833 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.475919 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.476075 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 12:50:25.476194 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.476510 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.476818 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:25.477063 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 12:50:25.631010 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO dbcounter [None req-53f58ed4-3ce7-45e0-b237-078ca113a9c3 None None] Registered counter for database nova_api Aug 03 12:50:25.631214 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO dbcounter [None req-fd2097dd-f14c-466b-b133-96c2d0c9b979 None None] Registered counter for database nova_api Aug 03 12:50:25.651797 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG oslo_db.sqlalchemy.engines [None req-fd2097dd-f14c-466b-b133-96c2d0c9b979 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104420) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:50:25.654623 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG oslo_db.sqlalchemy.engines [None req-53f58ed4-3ce7-45e0-b237-078ca113a9c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104419) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:50:25.658530 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG dbcounter [-] [104420] Writer thread running {{(pid=104420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:50:25.661316 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG dbcounter [-] [104419] Writer thread running {{(pid=104419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:50:25.713360 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.context [None req-fd2097dd-f14c-466b-b133-96c2d0c9b979 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d7258eba-25ec-4b0b-9efc-0af1d93beccb(cell1) {{(pid=104420) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 12:50:25.717097 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.context [None req-53f58ed4-3ce7-45e0-b237-078ca113a9c3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d7258eba-25ec-4b0b-9efc-0af1d93beccb(cell1) {{(pid=104419) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 12:50:25.717290 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG oslo_concurrency.lockutils [None req-fd2097dd-f14c-466b-b133-96c2d0c9b979 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:50:25.718891 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG oslo_concurrency.lockutils [None req-fd2097dd-f14c-466b-b133-96c2d0c9b979 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:50:25.719682 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG oslo_concurrency.lockutils [None req-fd2097dd-f14c-466b-b133-96c2d0c9b979 None None] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:50:25.721127 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG oslo_concurrency.lockutils [None req-53f58ed4-3ce7-45e0-b237-078ca113a9c3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:50:25.721623 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG oslo_concurrency.lockutils [None req-fd2097dd-f14c-466b-b133-96c2d0c9b979 None None] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:50:25.722751 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG oslo_concurrency.lockutils [None req-53f58ed4-3ce7-45e0-b237-078ca113a9c3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:50:25.723580 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG oslo_concurrency.lockutils [None req-53f58ed4-3ce7-45e0-b237-078ca113a9c3 None None] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:50:25.723698 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO dbcounter [None req-fd2097dd-f14c-466b-b133-96c2d0c9b979 None None] Registered counter for database nova_cell0 Aug 03 12:50:25.725556 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG oslo_concurrency.lockutils [None req-53f58ed4-3ce7-45e0-b237-078ca113a9c3 None None] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:50:25.727571 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO dbcounter [None req-53f58ed4-3ce7-45e0-b237-078ca113a9c3 None None] Registered counter for database nova_cell0 Aug 03 12:50:25.728843 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO dbcounter [None req-fd2097dd-f14c-466b-b133-96c2d0c9b979 None None] Registered counter for database nova_cell1 Aug 03 12:50:25.733494 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO dbcounter [None req-53f58ed4-3ce7-45e0-b237-078ca113a9c3 None None] Registered counter for database nova_cell1 Aug 03 12:50:25.736605 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG oslo_db.sqlalchemy.engines [None req-fd2097dd-f14c-466b-b133-96c2d0c9b979 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104420) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:50:25.738298 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG oslo_db.sqlalchemy.engines [None req-fd2097dd-f14c-466b-b133-96c2d0c9b979 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104420) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:50:25.740283 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG oslo_db.sqlalchemy.engines [None req-53f58ed4-3ce7-45e0-b237-078ca113a9c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104419) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:50:25.743593 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG oslo_db.sqlalchemy.engines [None req-53f58ed4-3ce7-45e0-b237-078ca113a9c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104419) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:50:25.744150 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG dbcounter [-] [104420] Writer thread running {{(pid=104420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:50:25.746430 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG dbcounter [-] [104419] Writer thread running {{(pid=104419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:50:25.881485 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG dbcounter [-] [104420] Writer thread running {{(pid=104420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:50:25.885315 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG dbcounter [-] [104419] Writer thread running {{(pid=104419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:50:25.891349 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO dbcounter [None req-fd2097dd-f14c-466b-b133-96c2d0c9b979 None None] Registered counter for database nova_cell0 Aug 03 12:50:25.894444 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO dbcounter [None req-53f58ed4-3ce7-45e0-b237-078ca113a9c3 None None] Registered counter for database nova_cell0 Aug 03 12:50:25.900319 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG oslo_db.sqlalchemy.engines [None req-fd2097dd-f14c-466b-b133-96c2d0c9b979 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104420) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:50:25.905046 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG oslo_db.sqlalchemy.engines [None req-53f58ed4-3ce7-45e0-b237-078ca113a9c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104419) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:50:25.905534 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG dbcounter [-] [104420] Writer thread running {{(pid=104420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:50:25.910413 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG dbcounter [-] [104419] Writer thread running {{(pid=104419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:50:26.299366 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: WARNING keystonemiddleware.auth_token [None req-fd2097dd-f14c-466b-b133-96c2d0c9b979 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 12:50:26.306628 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: WARNING keystonemiddleware.auth_token [None req-fd2097dd-f14c-466b-b133-96c2d0c9b979 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 12:50:26.328054 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: WARNING keystonemiddleware.auth_token [None req-53f58ed4-3ce7-45e0-b237-078ca113a9c3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 12:50:26.335528 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: WARNING keystonemiddleware.auth_token [None req-53f58ed4-3ce7-45e0-b237-078ca113a9c3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 12:50:26.647530 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: WARNING keystonemiddleware.auth_token [None req-fd2097dd-f14c-466b-b133-96c2d0c9b979 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 12:50:26.653414 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: WARNING keystonemiddleware.auth_token [None req-fd2097dd-f14c-466b-b133-96c2d0c9b979 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 12:50:26.659178 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5581e283f9c0 pid: 104420 (default app) Aug 03 12:50:26.661244 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-fd2097dd-f14c-466b-b133-96c2d0c9b979 None None] Calling method '>' {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:50:26.662678 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-fd2097dd-f14c-466b-b133-96c2d0c9b979 None None] 10.222.0.64 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001714 Aug 03 12:50:26.663119 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 788 bytes} [Wed Aug 3 12:50:26 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:50:26.677666 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: WARNING keystonemiddleware.auth_token [None req-53f58ed4-3ce7-45e0-b237-078ca113a9c3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 12:50:26.683608 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: WARNING keystonemiddleware.auth_token [None req-53f58ed4-3ce7-45e0-b237-078ca113a9c3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 12:50:26.688861 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5581e283f9c0 pid: 104419 (default app) Aug 03 12:51:44.698989 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-fd2097dd-f14c-466b-b133-96c2d0c9b979 None None] Calling method '>' {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:51:44.700581 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-fd2097dd-f14c-466b-b133-96c2d0c9b979 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002045 Aug 03 12:51:44.700974 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 2/2] 10.222.0.64 () {54 vars in 930 bytes} [Wed Aug 3 12:51:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:51:44.712760 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG dbcounter [-] [104419] Writing DB stats nova_api:SELECT=3 {{(pid=104419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:44.714099 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG dbcounter [-] [104419] Writing DB stats nova_cell1:SELECT=3 {{(pid=104419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:44.714967 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG dbcounter [-] [104419] Writing DB stats nova_cell0:SELECT=3 {{(pid=104419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:44.716078 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG dbcounter [-] [104419] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:45.589256 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-aa39e37c-71ea-4209-b535-52b8852f2b92 admin admin] Calling method '>' {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:51:45.621037 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-aa39e37c-71ea-4209-b535-52b8852f2b92 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.913342 Aug 03 12:51:45.626921 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 1/3] 10.222.0.64 () {60 vars in 1291 bytes} [Wed Aug 3 12:51:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:51:47.830892 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-fd2097dd-f14c-466b-b133-96c2d0c9b979 None None] Calling method '>' {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:51:47.831847 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-fd2097dd-f14c-466b-b133-96c2d0c9b979 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Aug 03 12:51:47.832398 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 3/4] 10.222.0.64 () {54 vars in 930 bytes} [Wed Aug 3 12:51:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:51:48.307595 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-bc389168-7a7c-4804-8a87-a708d54050ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "ram": 256, "vcpus": 1, "id": "c1"}} {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:51:48.328094 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:51:48.328094 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: warnings.warn(msg) Aug 03 12:51:48.424091 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-bc389168-7a7c-4804-8a87-a708d54050ef admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.585764 Aug 03 12:51:48.424769 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 2/5] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Aug 3 12:51:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:51:48.438971 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG dbcounter [-] [104420] Writing DB stats nova_api:SELECT=3 {{(pid=104420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:48.440165 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG dbcounter [-] [104420] Writing DB stats nova_cell1:SELECT=3 {{(pid=104420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:48.441171 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG dbcounter [-] [104420] Writing DB stats nova_cell0:SELECT=3 {{(pid=104420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:48.442030 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG dbcounter [-] [104420] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:48.649501 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-0cf71290-95cc-4a60-9f2a-bd9f80921cae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:51:48.653756 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:51:48.653756 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: warnings.warn(msg) Aug 03 12:51:48.796071 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-0cf71290-95cc-4a60-9f2a-bd9f80921cae admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.362248 Aug 03 12:51:48.796674 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 4/6] 10.222.0.64 () {64 vars in 1335 bytes} [Wed Aug 3 12:51:48 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:51:51.009755 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-bc389168-7a7c-4804-8a87-a708d54050ef admin admin] Calling method '>' {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:51:51.010810 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-bc389168-7a7c-4804-8a87-a708d54050ef admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Aug 03 12:51:51.011398 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 3/7] 10.222.0.64 () {54 vars in 930 bytes} [Wed Aug 3 12:51:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:51:51.713886 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-494e14e9-5ffc-4d08-b2b4-2367869cbb80 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "disk": 5, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "d1", "name": "ds512M"}} {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:51:51.733766 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:51:51.733766 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: warnings.warn(msg) Aug 03 12:51:51.839039 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-494e14e9-5ffc-4d08-b2b4-2367869cbb80 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.821352 Aug 03 12:51:51.839632 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 5/8] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Aug 3 12:51:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:51:51.856292 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-439acd50-dbf3-4399-b522-4b2488b08b28 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:51:51.859426 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:51:51.859426 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: warnings.warn(msg) Aug 03 12:51:51.977874 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-439acd50-dbf3-4399-b522-4b2488b08b28 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125998 Aug 03 12:51:51.978908 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 4/9] 10.222.0.64 () {64 vars in 1335 bytes} [Wed Aug 3 12:51:51 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:51:54.193354 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-494e14e9-5ffc-4d08-b2b4-2367869cbb80 admin admin] Calling method '>' {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:51:54.194372 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-494e14e9-5ffc-4d08-b2b4-2367869cbb80 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 03 12:51:54.194787 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 6/10] 10.222.0.64 () {54 vars in 930 bytes} [Wed Aug 3 12:51:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:51:54.593839 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-b4daad47-1e5c-4c07-afd3-e4a25353907a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "os-flavor-access:is_public": true, "name": "ds1G", "swap": 0, "disk": 10}} {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:51:54.814365 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-b4daad47-1e5c-4c07-afd3-e4a25353907a admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.613303 Aug 03 12:51:54.814947 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 5/11] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Aug 3 12:51:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:51:54.827091 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-ba214564-c7a0-4f7b-8dc0-c16eb12e5034 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:51:54.908793 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-ba214564-c7a0-4f7b-8dc0-c16eb12e5034 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085469 Aug 03 12:51:54.909358 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 7/12] 10.222.0.64 () {64 vars in 1335 bytes} [Wed Aug 3 12:51:54 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:51:57.089756 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-b4daad47-1e5c-4c07-afd3-e4a25353907a admin admin] Calling method '>' {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:51:57.090800 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-b4daad47-1e5c-4c07-afd3-e4a25353907a admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 03 12:51:57.091196 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 6/13] 10.222.0.64 () {54 vars in 930 bytes} [Wed Aug 3 12:51:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:51:57.531708 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-525c0000-e764-4f5d-8da4-0a3a95c8663c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "name": "ds2G"}} {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:51:57.605861 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-525c0000-e764-4f5d-8da4-0a3a95c8663c admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.508849 Aug 03 12:51:57.606674 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 8/14] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Aug 3 12:51:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 12:51:57.618831 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-b786ecd6-22ae-4e92-a4c5-f01ee7348082 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:51:57.715957 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-b786ecd6-22ae-4e92-a4c5-f01ee7348082 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100980 Aug 03 12:51:57.716567 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 7/15] 10.222.0.64 () {64 vars in 1335 bytes} [Wed Aug 3 12:51:57 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:51:59.904700 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-525c0000-e764-4f5d-8da4-0a3a95c8663c admin admin] Calling method '>' {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:51:59.905683 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-525c0000-e764-4f5d-8da4-0a3a95c8663c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Aug 03 12:51:59.906090 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 9/16] 10.222.0.64 () {54 vars in 930 bytes} [Wed Aug 3 12:51:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:52:00.343418 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-a5aa58cb-5c59-4046-a7cf-c605a4101be0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d4", "rxtx_factor": 1.0, "name": "ds4G", "swap": 0, "disk": 20, "vcpus": 4, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:52:00.431709 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-a5aa58cb-5c59-4046-a7cf-c605a4101be0 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.519639 Aug 03 12:52:00.438583 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 8/17] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Aug 3 12:51:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 12:52:00.444760 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-2f4c438b-f1ff-4011-848b-188d277caa4d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:52:00.548903 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-2f4c438b-f1ff-4011-848b-188d277caa4d admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107878 Aug 03 12:52:00.549624 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 10/18] 10.222.0.64 () {64 vars in 1335 bytes} [Wed Aug 3 12:52:00 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:52:02.755444 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-a5aa58cb-5c59-4046-a7cf-c605a4101be0 admin admin] Calling method '>' {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:52:02.756533 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-a5aa58cb-5c59-4046-a7cf-c605a4101be0 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001595 Aug 03 12:52:02.756978 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 9/19] 10.222.0.64 () {54 vars in 930 bytes} [Wed Aug 3 12:52:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:52:03.192747 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-cf1d5530-7b6f-4b8b-9174-d8f6f816e697 admin admin] Calling method '>' {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:52:03.218831 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-cf1d5530-7b6f-4b8b-9174-d8f6f816e697 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.455443 Aug 03 12:52:03.219404 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 11/20] 10.222.0.64 () {60 vars in 1291 bytes} [Wed Aug 3 12:52:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:52:05.747268 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-a5aa58cb-5c59-4046-a7cf-c605a4101be0 admin admin] Calling method '>' {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:52:05.748279 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-a5aa58cb-5c59-4046-a7cf-c605a4101be0 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 03 12:52:05.748680 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 10/21] 10.222.0.64 () {54 vars in 930 bytes} [Wed Aug 3 12:52:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:52:06.154191 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-960a7e05-58ed-4f61-a856-2bbcbfd7587f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "1", "disk": 1}} {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:52:06.226145 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-960a7e05-58ed-4f61-a856-2bbcbfd7587f admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.471344 Aug 03 12:52:06.226780 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 12/22] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Aug 3 12:52:05 2022] POST /compute/v2.1/flavors => generated 402 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:52:06.261949 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-f6d13be0-0577-4f52-b7f1-4a071d4dfd68 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:52:06.361116 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-f6d13be0-0577-4f52-b7f1-4a071d4dfd68 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125733 Aug 03 12:52:06.361846 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 11/23] 10.222.0.64 () {64 vars in 1332 bytes} [Wed Aug 3 12:52:06 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:52:08.535265 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-960a7e05-58ed-4f61-a856-2bbcbfd7587f admin admin] Calling method '>' {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:52:08.536425 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-960a7e05-58ed-4f61-a856-2bbcbfd7587f admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Aug 03 12:52:08.536840 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 13/24] 10.222.0.64 () {54 vars in 930 bytes} [Wed Aug 3 12:52:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:52:08.933105 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-1eb36dfb-65c8-4c9e-8f6d-6869caf12b26 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "id": "2", "disk": 20, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:52:09.006612 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-1eb36dfb-65c8-4c9e-8f6d-6869caf12b26 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.462940 Aug 03 12:52:09.007186 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 12/25] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Aug 3 12:52:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 12:52:09.020127 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-f2e5a252-bdf7-48ce-a5d5-aad607a4d072 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:52:09.102524 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-f2e5a252-bdf7-48ce-a5d5-aad607a4d072 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086015 Aug 03 12:52:09.103200 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 14/26] 10.222.0.64 () {64 vars in 1332 bytes} [Wed Aug 3 12:52:09 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:52:11.289121 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-1eb36dfb-65c8-4c9e-8f6d-6869caf12b26 admin admin] Calling method '>' {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:52:11.290695 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-1eb36dfb-65c8-4c9e-8f6d-6869caf12b26 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Aug 03 12:52:11.291121 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 13/27] 10.222.0.64 () {54 vars in 930 bytes} [Wed Aug 3 12:52:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:52:11.667017 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-63bb1e91-60f4-4d4b-b30c-f9db913b05ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "vcpus": 2, "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:52:11.750966 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-63bb1e91-60f4-4d4b-b30c-f9db913b05ac admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.453762 Aug 03 12:52:11.751530 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 15/28] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Aug 3 12:52:11 2022] POST /compute/v2.1/flavors => generated 406 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:52:11.763952 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-c31bac87-7be7-43dc-ac32-5ad0a4802099 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:52:11.859916 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-c31bac87-7be7-43dc-ac32-5ad0a4802099 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099547 Aug 03 12:52:11.861399 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 14/29] 10.222.0.64 () {64 vars in 1332 bytes} [Wed Aug 3 12:52:11 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:52:14.057990 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-63bb1e91-60f4-4d4b-b30c-f9db913b05ac admin admin] Calling method '>' {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:52:14.059020 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-63bb1e91-60f4-4d4b-b30c-f9db913b05ac admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Aug 03 12:52:14.059410 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 16/30] 10.222.0.64 () {54 vars in 930 bytes} [Wed Aug 3 12:52:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:52:14.574726 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-7b1a3740-8813-4f91-82c5-24e3524206d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "id": "4", "disk": 80, "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "os-flavor-access:is_public": true}} {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:52:15.431213 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG dbcounter [-] [104419] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=104419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:15.440509 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-7b1a3740-8813-4f91-82c5-24e3524206d7 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 1.373586 Aug 03 12:52:15.451153 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 15/31] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Aug 3 12:52:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:52:15.458478 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-89612966-305c-4e67-9fdc-d3e723fbd7a8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:52:15.543854 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-89612966-305c-4e67-9fdc-d3e723fbd7a8 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091465 Aug 03 12:52:15.547268 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 17/32] 10.222.0.64 () {64 vars in 1332 bytes} [Wed Aug 3 12:52:15 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:52:17.753062 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-7b1a3740-8813-4f91-82c5-24e3524206d7 admin admin] Calling method '>' {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:52:17.754222 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-7b1a3740-8813-4f91-82c5-24e3524206d7 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 Aug 03 12:52:17.754940 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 16/33] 10.222.0.64 () {54 vars in 930 bytes} [Wed Aug 3 12:52:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:52:18.195529 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-b02ad075-fdfe-4be9-8a3f-0f2635487559 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 16384, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "vcpus": 8, "id": "5"}} {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:52:18.286537 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-b02ad075-fdfe-4be9-8a3f-0f2635487559 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.521497 Aug 03 12:52:18.291417 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 18/34] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Aug 3 12:52:17 2022] POST /compute/v2.1/flavors => generated 408 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:52:18.296447 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-63d918a8-cd99-4f2c-9265-6290240c12af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:52:18.366636 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-63d918a8-cd99-4f2c-9265-6290240c12af admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074043 Aug 03 12:52:18.367354 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 17/35] 10.222.0.64 () {64 vars in 1332 bytes} [Wed Aug 3 12:52:18 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:52:38.167614 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-b02ad075-fdfe-4be9-8a3f-0f2635487559 admin admin] Calling method '>' {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:52:38.168624 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-b02ad075-fdfe-4be9-8a3f-0f2635487559 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Aug 03 12:52:38.169024 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 19/36] 10.222.0.64 () {54 vars in 930 bytes} [Wed Aug 3 12:52:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:52:38.679190 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-00f50c09-b290-4824-903f-e85b1623db6e admin admin] Calling method '>' {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:52:38.698310 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-00f50c09-b290-4824-903f-e85b1623db6e admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.523343 Aug 03 12:52:38.698873 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 18/37] 10.222.0.64 () {60 vars in 1291 bytes} [Wed Aug 3 12:52:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:52:39.755146 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-b02ad075-fdfe-4be9-8a3f-0f2635487559 admin admin] Calling method '>' {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:52:39.756151 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-b02ad075-fdfe-4be9-8a3f-0f2635487559 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 03 12:52:39.756550 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 20/38] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Aug 3 12:52:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:52:40.275684 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-73472a30-992b-4250-8f95-716f022e0956 admin admin] Calling method '>' {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:52:40.281261 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.wsgi [None req-73472a30-992b-4250-8f95-716f022e0956 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 03 12:52:40.284525 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-73472a30-992b-4250-8f95-716f022e0956 admin admin] Request method failure captured: Aug 03 12:52:40.284525 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 03 12:52:40.284525 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: Accept: application/json Aug 03 12:52:40.284525 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: Accept-Encoding: gzip, deflate Aug 03 12:52:40.284525 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: Connection: keep-alive Aug 03 12:52:40.284525 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: Content-Length: 0 Aug 03 12:52:40.284525 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: Host: 10.222.0.64 Aug 03 12:52:40.284525 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: Openstack-Api-Version: compute 2.90 Aug 03 12:52:40.284525 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: Openstack-System-Scope: None Aug 03 12:52:40.284525 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: User-Agent: python-novaclient Aug 03 12:52:40.284525 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Auth-Token: gAAAAABi6m-XUCpy5nJYDZJ-envezmtl7kAS9oxOv8BvAvXjdo3iVNNNF_HeHYQj2wEonKMl0BjDyJX2BgWiilJ-bRp0Dy13xwuXdtlgmvPdUjJHSSYyeesrrj0S2cU1RK5r3tk1IBZmpv5Bkg9AZ5mbhs9XEOepebhG3cuYJT4fE_CBYFnirYk Aug 03 12:52:40.284525 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Domain-Id: None Aug 03 12:52:40.284525 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Domain-Name: None Aug 03 12:52:40.284525 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Identity-Status: Confirmed Aug 03 12:52:40.284525 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Is-Admin-Project: True Aug 03 12:52:40.284525 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 12:52:40.284525 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Project-Domain-Id: default Aug 03 12:52:40.284525 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Project-Domain-Name: Default Aug 03 12:52:40.284525 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Project-Id: 5d023a6b024c4cbd9df738e8fd9e9a97 Aug 03 12:52:40.284525 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Project-Name: admin Aug 03 12:52:40.284525 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Role: member,admin,reader Aug 03 12:52:40.284525 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Roles: member,admin,reader Aug 03 12:52:40.286101 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5d023a6b024c4cbd9df738e8fd9e9a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5d023a6b024c4cbd9df738e8fd9e9a97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5d023a6b024c4cbd9df738e8fd9e9a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5d023a6b024c4cbd9df738e8fd9e9a97", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 12:52:40.286101 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Tenant: admin Aug 03 12:52:40.286101 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Tenant-Id: 5d023a6b024c4cbd9df738e8fd9e9a97 Aug 03 12:52:40.286101 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Tenant-Name: admin Aug 03 12:52:40.286101 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-User: admin Aug 03 12:52:40.286101 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-User-Domain-Id: default Aug 03 12:52:40.286101 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-User-Domain-Name: Default Aug 03 12:52:40.286101 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-User-Id: 9b2212edbdbd4786821e28173abce27f Aug 03 12:52:40.286101 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-User-Name: admin Aug 03 12:52:40.286101 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: method: > Aug 03 12:52:40.286101 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: exception: Flavor 42 could not be found. Aug 03 12:52:40.286101 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: action_args: {'id': '42'} Aug 03 12:52:40.286101 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:52:40.286101 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:52:40.287060 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 12:52:40.287060 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 12:52:40.287060 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 12:52:40.287060 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 12:52:40.287060 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 12:52:40.287060 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 12:52:40.287060 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 12:52:40.287060 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 12:52:40.287060 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 12:52:40.287060 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:52:40.287060 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 12:52:40.287060 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 12:52:40.287060 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 03 12:52:40.287060 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi Aug 03 12:52:40.287060 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:52:40.287060 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi Aug 03 12:52:40.287060 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:52:40.287060 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:52:40.287060 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:52:40.288476 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:52:40.288476 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:52:40.288476 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:52:40.288476 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:52:40.288476 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 12:52:40.288476 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:52:40.288476 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 03 12:52:40.288476 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi Aug 03 12:52:40.288476 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:52:40.288476 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi Aug 03 12:52:40.288476 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:52:40.288476 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:52:40.288476 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:52:40.288476 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:52:40.288476 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:52:40.288476 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 03 12:52:40.288476 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi Aug 03 12:52:40.288476 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-73472a30-992b-4250-8f95-716f022e0956 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104419) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:52:40.290230 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-73472a30-992b-4250-8f95-716f022e0956 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.393015 Aug 03 12:52:40.290230 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 19/39] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Aug 3 12:52:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:40.296376 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-717b6e5c-1f97-4678-b520-8f2670437699 admin admin] Calling method '>' {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:52:40.300628 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG dbcounter [-] [104420] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=104420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:40.319099 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-717b6e5c-1f97-4678-b520-8f2670437699 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026177 Aug 03 12:52:40.319628 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 21/40] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Aug 3 12:52:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:52:40.329325 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-7005dcdb-5fb5-492c-ba2d-d2e2a2376811 admin admin] Calling method '>' {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:52:40.353728 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-7005dcdb-5fb5-492c-ba2d-d2e2a2376811 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028054 Aug 03 12:52:40.354270 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 20/41] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Aug 3 12:52:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:52:40.363607 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-a01df669-5746-4c5f-8d28-ba28ec928150 admin admin] Calling method '>' {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:52:40.369291 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.wsgi [None req-a01df669-5746-4c5f-8d28-ba28ec928150 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 03 12:52:40.372530 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-a01df669-5746-4c5f-8d28-ba28ec928150 admin admin] Request method failure captured: Aug 03 12:52:40.372530 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 03 12:52:40.372530 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: Accept: application/json Aug 03 12:52:40.372530 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: Accept-Encoding: gzip, deflate Aug 03 12:52:40.372530 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: Connection: keep-alive Aug 03 12:52:40.372530 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: Content-Length: 0 Aug 03 12:52:40.372530 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: Host: 10.222.0.64 Aug 03 12:52:40.372530 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: Openstack-Api-Version: compute 2.90 Aug 03 12:52:40.372530 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: Openstack-System-Scope: None Aug 03 12:52:40.372530 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: User-Agent: python-novaclient Aug 03 12:52:40.372530 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Auth-Token: gAAAAABi6m-XUCpy5nJYDZJ-envezmtl7kAS9oxOv8BvAvXjdo3iVNNNF_HeHYQj2wEonKMl0BjDyJX2BgWiilJ-bRp0Dy13xwuXdtlgmvPdUjJHSSYyeesrrj0S2cU1RK5r3tk1IBZmpv5Bkg9AZ5mbhs9XEOepebhG3cuYJT4fE_CBYFnirYk Aug 03 12:52:40.372530 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Domain-Id: None Aug 03 12:52:40.372530 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Domain-Name: None Aug 03 12:52:40.372530 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Identity-Status: Confirmed Aug 03 12:52:40.372530 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Is-Admin-Project: True Aug 03 12:52:40.372530 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 12:52:40.372530 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Project-Domain-Id: default Aug 03 12:52:40.372530 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Project-Domain-Name: Default Aug 03 12:52:40.372530 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Project-Id: 5d023a6b024c4cbd9df738e8fd9e9a97 Aug 03 12:52:40.372530 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Project-Name: admin Aug 03 12:52:40.372530 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Role: member,admin,reader Aug 03 12:52:40.372530 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Roles: member,admin,reader Aug 03 12:52:40.374078 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5d023a6b024c4cbd9df738e8fd9e9a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5d023a6b024c4cbd9df738e8fd9e9a97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5d023a6b024c4cbd9df738e8fd9e9a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5d023a6b024c4cbd9df738e8fd9e9a97", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 12:52:40.374078 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Tenant: admin Aug 03 12:52:40.374078 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Tenant-Id: 5d023a6b024c4cbd9df738e8fd9e9a97 Aug 03 12:52:40.374078 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Tenant-Name: admin Aug 03 12:52:40.374078 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-User: admin Aug 03 12:52:40.374078 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-User-Domain-Id: default Aug 03 12:52:40.374078 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-User-Domain-Name: Default Aug 03 12:52:40.374078 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-User-Id: 9b2212edbdbd4786821e28173abce27f Aug 03 12:52:40.374078 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-User-Name: admin Aug 03 12:52:40.374078 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: method: > Aug 03 12:52:40.374078 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: exception: Flavor 42 could not be found. Aug 03 12:52:40.374078 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: action_args: {'id': '42'} Aug 03 12:52:40.374078 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:52:40.374078 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:52:40.381216 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 12:52:40.381216 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 12:52:40.381216 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 12:52:40.381216 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 12:52:40.381216 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 12:52:40.381216 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 12:52:40.381216 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 12:52:40.381216 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 12:52:40.381216 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 12:52:40.381216 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:52:40.381216 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 12:52:40.381216 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 12:52:40.381216 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 03 12:52:40.381216 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi Aug 03 12:52:40.381216 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:52:40.381216 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi Aug 03 12:52:40.381216 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:52:40.381216 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:52:40.381216 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:52:40.382511 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:52:40.382511 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:52:40.382511 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:52:40.382511 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:52:40.382511 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 12:52:40.382511 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:52:40.382511 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 03 12:52:40.382511 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi Aug 03 12:52:40.382511 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:52:40.382511 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi Aug 03 12:52:40.382511 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:52:40.382511 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:52:40.382511 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:52:40.382511 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:52:40.382511 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:52:40.382511 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 03 12:52:40.382511 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi Aug 03 12:52:40.382511 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-a01df669-5746-4c5f-8d28-ba28ec928150 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104420) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:52:40.383777 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-a01df669-5746-4c5f-8d28-ba28ec928150 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014124 Aug 03 12:52:40.383777 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 22/42] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Aug 3 12:52:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:41.342578 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-7005dcdb-5fb5-492c-ba2d-d2e2a2376811 admin admin] Calling method '>' {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:52:41.344097 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-7005dcdb-5fb5-492c-ba2d-d2e2a2376811 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002230 Aug 03 12:52:41.344490 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 21/43] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Aug 3 12:52:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:52:41.865512 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-3316a3ed-5245-4e60-9a88-768071d554d2 admin admin] Calling method '>' {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:52:41.870917 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.wsgi [None req-3316a3ed-5245-4e60-9a88-768071d554d2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 03 12:52:41.872412 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-3316a3ed-5245-4e60-9a88-768071d554d2 admin admin] Request method failure captured: Aug 03 12:52:41.872412 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 03 12:52:41.872412 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: Accept: application/json Aug 03 12:52:41.872412 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: Accept-Encoding: gzip, deflate Aug 03 12:52:41.872412 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: Connection: keep-alive Aug 03 12:52:41.872412 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: Content-Length: 0 Aug 03 12:52:41.872412 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: Host: 10.222.0.64 Aug 03 12:52:41.872412 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: Openstack-Api-Version: compute 2.90 Aug 03 12:52:41.872412 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: Openstack-System-Scope: None Aug 03 12:52:41.872412 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: User-Agent: python-novaclient Aug 03 12:52:41.872412 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Auth-Token: gAAAAABi6m-ZC7GEq-PVZdLufWUWwpwFOBHqA-SQ4xc34mXJZR5-4cclWAVqFmtiwSoR0iyohaeC2PF2ZykdjeChit51vZwIN1w5B1_bNkox0fnO-YGgssqiszQr4307LQKGHZxov0mrqZ8WhKAcHajGWKgo7bEdkDg5yDAUe_hm_X0LSbIODVQ Aug 03 12:52:41.872412 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Domain-Id: None Aug 03 12:52:41.872412 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Domain-Name: None Aug 03 12:52:41.872412 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Identity-Status: Confirmed Aug 03 12:52:41.872412 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Is-Admin-Project: True Aug 03 12:52:41.872412 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 12:52:41.872412 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Project-Domain-Id: default Aug 03 12:52:41.872412 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Project-Domain-Name: Default Aug 03 12:52:41.872412 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Project-Id: 5d023a6b024c4cbd9df738e8fd9e9a97 Aug 03 12:52:41.872412 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Project-Name: admin Aug 03 12:52:41.872412 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Role: member,admin,reader Aug 03 12:52:41.872412 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Roles: member,admin,reader Aug 03 12:52:41.873968 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5d023a6b024c4cbd9df738e8fd9e9a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5d023a6b024c4cbd9df738e8fd9e9a97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5d023a6b024c4cbd9df738e8fd9e9a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5d023a6b024c4cbd9df738e8fd9e9a97", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 12:52:41.873968 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Tenant: admin Aug 03 12:52:41.873968 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Tenant-Id: 5d023a6b024c4cbd9df738e8fd9e9a97 Aug 03 12:52:41.873968 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Tenant-Name: admin Aug 03 12:52:41.873968 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-User: admin Aug 03 12:52:41.873968 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-User-Domain-Id: default Aug 03 12:52:41.873968 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-User-Domain-Name: Default Aug 03 12:52:41.873968 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-User-Id: 9b2212edbdbd4786821e28173abce27f Aug 03 12:52:41.873968 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-User-Name: admin Aug 03 12:52:41.873968 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: method: > Aug 03 12:52:41.873968 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: exception: Flavor 84 could not be found. Aug 03 12:52:41.873968 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: action_args: {'id': '84'} Aug 03 12:52:41.873968 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:52:41.873968 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:52:41.874984 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 12:52:41.874984 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 12:52:41.874984 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 12:52:41.874984 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 12:52:41.874984 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 12:52:41.874984 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 12:52:41.874984 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 12:52:41.874984 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 12:52:41.874984 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 12:52:41.874984 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:52:41.874984 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 12:52:41.874984 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 12:52:41.874984 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 03 12:52:41.874984 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi Aug 03 12:52:41.874984 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:52:41.874984 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi Aug 03 12:52:41.874984 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:52:41.874984 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:52:41.874984 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:52:41.876474 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:52:41.876474 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:52:41.876474 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:52:41.876474 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:52:41.876474 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 12:52:41.876474 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:52:41.876474 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 03 12:52:41.876474 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi Aug 03 12:52:41.876474 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:52:41.876474 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi Aug 03 12:52:41.876474 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:52:41.876474 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:52:41.876474 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:52:41.876474 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:52:41.876474 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:52:41.876474 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 03 12:52:41.876474 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi Aug 03 12:52:41.876474 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-3316a3ed-5245-4e60-9a88-768071d554d2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104420) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:52:41.877719 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-3316a3ed-5245-4e60-9a88-768071d554d2 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.389921 Aug 03 12:52:41.877719 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 23/44] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Aug 3 12:52:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:41.883437 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-7e9f4b7d-9611-43e8-9921-606d897fdb00 admin admin] Calling method '>' {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:52:41.897918 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-7e9f4b7d-9611-43e8-9921-606d897fdb00 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018059 Aug 03 12:52:41.898977 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 22/45] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Aug 3 12:52:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:52:41.908029 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-0357159b-a6e5-4f70-89f5-e06caf18ee32 admin admin] Calling method '>' {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:52:41.923661 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-0357159b-a6e5-4f70-89f5-e06caf18ee32 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019073 Aug 03 12:52:41.924180 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 24/46] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Aug 3 12:52:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:52:41.933280 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-519a1d38-d2bc-4b93-a495-27223fcc4d01 admin admin] Calling method '>' {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:52:41.938503 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.wsgi [None req-519a1d38-d2bc-4b93-a495-27223fcc4d01 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 03 12:52:41.940017 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-519a1d38-d2bc-4b93-a495-27223fcc4d01 admin admin] Request method failure captured: Aug 03 12:52:41.940017 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 03 12:52:41.940017 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: Accept: application/json Aug 03 12:52:41.940017 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: Accept-Encoding: gzip, deflate Aug 03 12:52:41.940017 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: Connection: keep-alive Aug 03 12:52:41.940017 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: Content-Length: 0 Aug 03 12:52:41.940017 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: Host: 10.222.0.64 Aug 03 12:52:41.940017 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: Openstack-Api-Version: compute 2.90 Aug 03 12:52:41.940017 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: Openstack-System-Scope: None Aug 03 12:52:41.940017 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: User-Agent: python-novaclient Aug 03 12:52:41.940017 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Auth-Token: gAAAAABi6m-ZC7GEq-PVZdLufWUWwpwFOBHqA-SQ4xc34mXJZR5-4cclWAVqFmtiwSoR0iyohaeC2PF2ZykdjeChit51vZwIN1w5B1_bNkox0fnO-YGgssqiszQr4307LQKGHZxov0mrqZ8WhKAcHajGWKgo7bEdkDg5yDAUe_hm_X0LSbIODVQ Aug 03 12:52:41.940017 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Domain-Id: None Aug 03 12:52:41.940017 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Domain-Name: None Aug 03 12:52:41.940017 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Identity-Status: Confirmed Aug 03 12:52:41.940017 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Is-Admin-Project: True Aug 03 12:52:41.940017 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 12:52:41.940017 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Project-Domain-Id: default Aug 03 12:52:41.940017 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Project-Domain-Name: Default Aug 03 12:52:41.940017 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Project-Id: 5d023a6b024c4cbd9df738e8fd9e9a97 Aug 03 12:52:41.940017 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Project-Name: admin Aug 03 12:52:41.940017 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Role: member,admin,reader Aug 03 12:52:41.940017 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Roles: member,admin,reader Aug 03 12:52:41.941515 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5d023a6b024c4cbd9df738e8fd9e9a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5d023a6b024c4cbd9df738e8fd9e9a97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5d023a6b024c4cbd9df738e8fd9e9a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5d023a6b024c4cbd9df738e8fd9e9a97", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 12:52:41.941515 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Tenant: admin Aug 03 12:52:41.941515 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Tenant-Id: 5d023a6b024c4cbd9df738e8fd9e9a97 Aug 03 12:52:41.941515 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Tenant-Name: admin Aug 03 12:52:41.941515 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-User: admin Aug 03 12:52:41.941515 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-User-Domain-Id: default Aug 03 12:52:41.941515 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-User-Domain-Name: Default Aug 03 12:52:41.941515 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-User-Id: 9b2212edbdbd4786821e28173abce27f Aug 03 12:52:41.941515 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-User-Name: admin Aug 03 12:52:41.941515 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: method: > Aug 03 12:52:41.941515 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: exception: Flavor 84 could not be found. Aug 03 12:52:41.941515 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: action_args: {'id': '84'} Aug 03 12:52:41.941515 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:52:41.941515 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:52:41.942459 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 12:52:41.942459 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 12:52:41.942459 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 12:52:41.942459 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 12:52:41.942459 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 12:52:41.942459 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 12:52:41.942459 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 12:52:41.942459 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 12:52:41.942459 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 12:52:41.942459 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:52:41.942459 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 12:52:41.942459 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 12:52:41.942459 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 03 12:52:41.942459 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi Aug 03 12:52:41.942459 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:52:41.942459 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi Aug 03 12:52:41.942459 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:52:41.942459 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:52:41.942459 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:52:41.943637 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:52:41.943637 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:52:41.943637 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:52:41.943637 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:52:41.943637 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 12:52:41.943637 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:52:41.943637 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 03 12:52:41.943637 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi Aug 03 12:52:41.943637 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:52:41.943637 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi Aug 03 12:52:41.943637 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:52:41.943637 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:52:41.943637 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:52:41.943637 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:52:41.943637 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:52:41.943637 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 03 12:52:41.943637 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi Aug 03 12:52:41.943637 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-519a1d38-d2bc-4b93-a495-27223fcc4d01 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104419) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:52:41.944632 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-519a1d38-d2bc-4b93-a495-27223fcc4d01 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011553 Aug 03 12:52:41.944632 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 23/47] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Aug 3 12:52:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 03 12:52:42.908362 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-0357159b-a6e5-4f70-89f5-e06caf18ee32 admin admin] Calling method '>' {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:52:42.909402 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-0357159b-a6e5-4f70-89f5-e06caf18ee32 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Aug 03 12:52:42.909794 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 25/48] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Aug 3 12:52:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:52:43.425385 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-d9ca1e99-fde6-4636-8988-3eb3c6463404 admin admin] Calling method '>' {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:52:43.431650 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.wsgi [None req-d9ca1e99-fde6-4636-8988-3eb3c6463404 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 03 12:52:43.433160 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-d9ca1e99-fde6-4636-8988-3eb3c6463404 admin admin] Request method failure captured: Aug 03 12:52:43.433160 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 03 12:52:43.433160 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: Accept: application/json Aug 03 12:52:43.433160 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: Accept-Encoding: gzip, deflate Aug 03 12:52:43.433160 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: Connection: keep-alive Aug 03 12:52:43.433160 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: Content-Length: 0 Aug 03 12:52:43.433160 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: Host: 10.222.0.64 Aug 03 12:52:43.433160 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: Openstack-Api-Version: compute 2.90 Aug 03 12:52:43.433160 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: Openstack-System-Scope: None Aug 03 12:52:43.433160 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: User-Agent: python-novaclient Aug 03 12:52:43.433160 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Auth-Token: gAAAAABi6m-av8YvwnTQNhg4ubXa-ZQrr2KOVI7pT3KR_Sb3glTOegXzuzRrjBGaN61h2KZ7nitTUyEtZjgUvpF4qwVGkyRKRwrTza1wEbTt2udcEsQtqGlG96Qzcm9OKDt4f9MBwLVqIk7cQliHC_52IbruKqGpCxVNTjGzwmmJlMkppQIwNy0 Aug 03 12:52:43.433160 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Domain-Id: None Aug 03 12:52:43.433160 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Domain-Name: None Aug 03 12:52:43.433160 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Identity-Status: Confirmed Aug 03 12:52:43.433160 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Is-Admin-Project: True Aug 03 12:52:43.433160 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 12:52:43.433160 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Project-Domain-Id: default Aug 03 12:52:43.433160 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Project-Domain-Name: Default Aug 03 12:52:43.433160 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Project-Id: 5d023a6b024c4cbd9df738e8fd9e9a97 Aug 03 12:52:43.433160 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Project-Name: admin Aug 03 12:52:43.433160 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Role: member,admin,reader Aug 03 12:52:43.433160 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Roles: member,admin,reader Aug 03 12:52:43.434868 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5d023a6b024c4cbd9df738e8fd9e9a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5d023a6b024c4cbd9df738e8fd9e9a97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5d023a6b024c4cbd9df738e8fd9e9a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5d023a6b024c4cbd9df738e8fd9e9a97", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 12:52:43.434868 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Tenant: admin Aug 03 12:52:43.434868 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Tenant-Id: 5d023a6b024c4cbd9df738e8fd9e9a97 Aug 03 12:52:43.434868 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-Tenant-Name: admin Aug 03 12:52:43.434868 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-User: admin Aug 03 12:52:43.434868 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-User-Domain-Id: default Aug 03 12:52:43.434868 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-User-Domain-Name: Default Aug 03 12:52:43.434868 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-User-Id: 9b2212edbdbd4786821e28173abce27f Aug 03 12:52:43.434868 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: X-User-Name: admin Aug 03 12:52:43.434868 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: method: > Aug 03 12:52:43.434868 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: exception: Flavor 451 could not be found. Aug 03 12:52:43.434868 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: action_args: {'id': '451'} Aug 03 12:52:43.434868 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:52:43.434868 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:52:43.435742 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 12:52:43.435742 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 12:52:43.435742 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 12:52:43.435742 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 12:52:43.435742 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 12:52:43.435742 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 12:52:43.435742 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 12:52:43.435742 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 12:52:43.435742 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 12:52:43.435742 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:52:43.435742 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 12:52:43.435742 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 12:52:43.435742 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 03 12:52:43.435742 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi Aug 03 12:52:43.435742 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:52:43.435742 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi Aug 03 12:52:43.435742 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:52:43.435742 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:52:43.435742 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:52:43.437081 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:52:43.437081 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:52:43.437081 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:52:43.437081 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:52:43.437081 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 12:52:43.437081 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:52:43.437081 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 03 12:52:43.437081 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi Aug 03 12:52:43.437081 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:52:43.437081 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi Aug 03 12:52:43.437081 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:52:43.437081 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:52:43.437081 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:52:43.437081 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:52:43.437081 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:52:43.437081 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 03 12:52:43.437081 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: ERROR nova.api.openstack.wsgi Aug 03 12:52:43.437081 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-d9ca1e99-fde6-4636-8988-3eb3c6463404 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104419) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:52:43.438335 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-d9ca1e99-fde6-4636-8988-3eb3c6463404 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.388389 Aug 03 12:52:43.438335 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 24/49] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Aug 3 12:52:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:43.444033 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-16b2afce-7dff-466a-8e65-8372fd4d1ebb admin admin] Calling method '>' {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:52:43.459190 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-16b2afce-7dff-466a-8e65-8372fd4d1ebb admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018646 Aug 03 12:52:43.459701 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 26/50] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Aug 3 12:52:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:52:43.468623 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-1d434478-9712-44fb-aa89-471aaf921cf1 admin admin] Calling method '>' {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:52:43.483717 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-1d434478-9712-44fb-aa89-471aaf921cf1 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018499 Aug 03 12:52:43.484232 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 25/51] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Aug 3 12:52:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:52:43.493762 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-0bab0ab3-d537-40e9-b54b-77c3f1509380 admin admin] Calling method '>' {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:52:43.498923 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.wsgi [None req-0bab0ab3-d537-40e9-b54b-77c3f1509380 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 03 12:52:43.500385 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-0bab0ab3-d537-40e9-b54b-77c3f1509380 admin admin] Request method failure captured: Aug 03 12:52:43.500385 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 03 12:52:43.500385 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: Accept: application/json Aug 03 12:52:43.500385 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: Accept-Encoding: gzip, deflate Aug 03 12:52:43.500385 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: Connection: keep-alive Aug 03 12:52:43.500385 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: Content-Length: 0 Aug 03 12:52:43.500385 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: Host: 10.222.0.64 Aug 03 12:52:43.500385 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: Openstack-Api-Version: compute 2.90 Aug 03 12:52:43.500385 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: Openstack-System-Scope: None Aug 03 12:52:43.500385 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: User-Agent: python-novaclient Aug 03 12:52:43.500385 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Auth-Token: gAAAAABi6m-av8YvwnTQNhg4ubXa-ZQrr2KOVI7pT3KR_Sb3glTOegXzuzRrjBGaN61h2KZ7nitTUyEtZjgUvpF4qwVGkyRKRwrTza1wEbTt2udcEsQtqGlG96Qzcm9OKDt4f9MBwLVqIk7cQliHC_52IbruKqGpCxVNTjGzwmmJlMkppQIwNy0 Aug 03 12:52:43.500385 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Domain-Id: None Aug 03 12:52:43.500385 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Domain-Name: None Aug 03 12:52:43.500385 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Identity-Status: Confirmed Aug 03 12:52:43.500385 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Is-Admin-Project: True Aug 03 12:52:43.500385 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 12:52:43.500385 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Project-Domain-Id: default Aug 03 12:52:43.500385 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Project-Domain-Name: Default Aug 03 12:52:43.500385 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Project-Id: 5d023a6b024c4cbd9df738e8fd9e9a97 Aug 03 12:52:43.500385 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Project-Name: admin Aug 03 12:52:43.500385 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Role: member,admin,reader Aug 03 12:52:43.500385 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Roles: member,admin,reader Aug 03 12:52:43.501949 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5d023a6b024c4cbd9df738e8fd9e9a97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5d023a6b024c4cbd9df738e8fd9e9a97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5d023a6b024c4cbd9df738e8fd9e9a97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5d023a6b024c4cbd9df738e8fd9e9a97", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 12:52:43.501949 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Tenant: admin Aug 03 12:52:43.501949 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Tenant-Id: 5d023a6b024c4cbd9df738e8fd9e9a97 Aug 03 12:52:43.501949 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-Tenant-Name: admin Aug 03 12:52:43.501949 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-User: admin Aug 03 12:52:43.501949 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-User-Domain-Id: default Aug 03 12:52:43.501949 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-User-Domain-Name: Default Aug 03 12:52:43.501949 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-User-Id: 9b2212edbdbd4786821e28173abce27f Aug 03 12:52:43.501949 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: X-User-Name: admin Aug 03 12:52:43.501949 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: method: > Aug 03 12:52:43.501949 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: exception: Flavor 451 could not be found. Aug 03 12:52:43.501949 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: action_args: {'id': '451'} Aug 03 12:52:43.501949 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:52:43.501949 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:52:43.502943 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 12:52:43.502943 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 12:52:43.502943 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 12:52:43.502943 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 12:52:43.502943 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 12:52:43.502943 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 12:52:43.502943 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 12:52:43.502943 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 12:52:43.502943 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 12:52:43.502943 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:52:43.502943 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 12:52:43.502943 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 12:52:43.502943 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 03 12:52:43.502943 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi Aug 03 12:52:43.502943 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:52:43.502943 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi Aug 03 12:52:43.502943 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:52:43.502943 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:52:43.502943 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:52:43.504205 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:52:43.504205 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:52:43.504205 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:52:43.504205 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:52:43.504205 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 12:52:43.504205 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:52:43.504205 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 03 12:52:43.504205 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi Aug 03 12:52:43.504205 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:52:43.504205 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi Aug 03 12:52:43.504205 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:52:43.504205 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:52:43.504205 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:52:43.504205 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:52:43.504205 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:52:43.504205 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 03 12:52:43.504205 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: ERROR nova.api.openstack.wsgi Aug 03 12:52:43.504205 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-0bab0ab3-d537-40e9-b54b-77c3f1509380 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104420) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:52:43.505471 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-0bab0ab3-d537-40e9-b54b-77c3f1509380 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011989 Aug 03 12:52:43.505471 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 27/52] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Aug 3 12:52:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 03 12:52:44.465018 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-1d434478-9712-44fb-aa89-471aaf921cf1 admin admin] Calling method '>' {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:52:44.466015 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-1d434478-9712-44fb-aa89-471aaf921cf1 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Aug 03 12:52:44.466401 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 26/53] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Aug 3 12:52:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:52:44.986063 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-86bb37d3-6d7f-4b5b-aefe-4468639e4991 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:52:45.058891 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-86bb37d3-6d7f-4b5b-aefe-4468639e4991 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.456149 Aug 03 12:52:45.059353 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 28/54] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Aug 3 12:52:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:52:46.019569 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-1d434478-9712-44fb-aa89-471aaf921cf1 admin admin] Calling method '>' {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:52:46.020585 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-1d434478-9712-44fb-aa89-471aaf921cf1 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 03 12:52:46.021012 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 27/55] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Aug 3 12:52:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:52:46.542906 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-a64d4464-37ad-4b90-bd55-86700525f5bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:52:46.641729 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-a64d4464-37ad-4b90-bd55-86700525f5bb admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.482336 Aug 03 12:52:46.642283 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 29/56] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Aug 3 12:52:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:52:47.601687 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-1d434478-9712-44fb-aa89-471aaf921cf1 admin admin] Calling method '>' {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:52:47.602682 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-1d434478-9712-44fb-aa89-471aaf921cf1 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001930 Aug 03 12:52:47.603097 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 28/57] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Aug 3 12:52:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:52:48.125266 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-4984c2b5-73dc-40f5-9f88-ee5ad9d3691f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:52:48.189983 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-4984c2b5-73dc-40f5-9f88-ee5ad9d3691f admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.446626 Aug 03 12:52:48.190527 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 30/58] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Aug 3 12:52:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:52:49.152893 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-1d434478-9712-44fb-aa89-471aaf921cf1 admin admin] Calling method '>' {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:52:49.153899 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-1d434478-9712-44fb-aa89-471aaf921cf1 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Aug 03 12:52:49.154317 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 29/59] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Aug 3 12:52:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:52:49.672532 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-182ce105-85de-4c02-b552-fd894c089da1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:52:49.749143 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-182ce105-85de-4c02-b552-fd894c089da1 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.457773 Aug 03 12:52:49.749689 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 31/60] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Aug 3 12:52:49 2022] POST /compute/v2.1/flavors => generated 409 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:52:50.727551 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-1d434478-9712-44fb-aa89-471aaf921cf1 admin admin] Calling method '>' {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:52:50.728564 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-1d434478-9712-44fb-aa89-471aaf921cf1 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 03 12:52:50.728965 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 30/61] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Aug 3 12:52:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:52:51.247171 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-155f54e5-4b4d-4cc8-b762-f3b503886fa8 admin admin] Calling method '>' {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:52:51.267597 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-155f54e5-4b4d-4cc8-b762-f3b503886fa8 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.401716 Aug 03 12:52:51.268141 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 32/62] 10.222.0.64 () {60 vars in 1202 bytes} [Wed Aug 3 12:52:50 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:53:42.236270 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-1d434478-9712-44fb-aa89-471aaf921cf1 admin admin] Calling method '>' {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:53:42.237279 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-1d434478-9712-44fb-aa89-471aaf921cf1 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Aug 03 12:53:42.237669 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 31/63] 10.222.0.64 () {54 vars in 930 bytes} [Wed Aug 3 12:53:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:53:42.248320 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG dbcounter [-] [104420] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:42.623568 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-48147a79-0fac-4415-8cc3-4a7912d51c8e admin admin] Calling method '>' {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:53:42.644104 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-48147a79-0fac-4415-8cc3-4a7912d51c8e admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.400534 Aug 03 12:53:42.644641 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 33/64] 10.222.0.64 () {60 vars in 1291 bytes} [Wed Aug 3 12:53:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:53:42.667518 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-e8f0cb2e-98f7-4e22-8d1f-a373b47ed7c5 admin admin] Calling method '>' {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:53:42.671041 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG dbcounter [-] [104419] Writing DB stats nova_api:SELECT=21,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=104419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:42.675898 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-e8f0cb2e-98f7-4e22-8d1f-a373b47ed7c5 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011983 Aug 03 12:53:42.681769 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 32/65] 10.222.0.64 () {60 vars in 1282 bytes} [Wed Aug 3 12:53:42 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:53:42.688192 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-7b1819f3-ad6d-429a-aece-893824b1157d admin admin] Calling method '>' {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:53:42.696384 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-7b1819f3-ad6d-429a-aece-893824b1157d admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011721 Aug 03 12:53:42.696902 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 34/66] 10.222.0.64 () {60 vars in 1285 bytes} [Wed Aug 3 12:53:42 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:53:42.708236 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-2f5b9785-0ccf-4061-a899-73ad7cfbaecb admin admin] Calling method '>' {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:53:42.715661 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-2f5b9785-0ccf-4061-a899-73ad7cfbaecb admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011187 Aug 03 12:53:42.718184 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 33/67] 10.222.0.64 () {60 vars in 1285 bytes} [Wed Aug 3 12:53:42 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:53:42.727604 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-268eb0d3-b74c-4ac9-a204-a993421d4ef7 admin admin] Calling method '>' {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:53:42.735008 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-268eb0d3-b74c-4ac9-a204-a993421d4ef7 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011262 Aug 03 12:53:42.735515 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 35/68] 10.222.0.64 () {60 vars in 1282 bytes} [Wed Aug 3 12:53:42 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:57:21.260526 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-2f5b9785-0ccf-4061-a899-73ad7cfbaecb admin admin] Calling method '>' {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:57:21.261541 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-2f5b9785-0ccf-4061-a899-73ad7cfbaecb admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 03 12:57:21.261933 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 34/69] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Aug 3 12:57:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:57:21.401072 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG dbcounter [-] [104420] Writing DB stats nova_api:SELECT=6 {{(pid=104420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:57:21.560671 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-7ed880d0-6a8a-42e4-827e-f4213a736a7f admin admin] Calling method '>' {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:57:21.563029 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:57:21.563029 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: warnings.warn(msg) Aug 03 12:57:21.564250 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG oslo_concurrency.lockutils [None req-7ed880d0-6a8a-42e4-827e-f4213a736a7f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:57:21.564685 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG oslo_concurrency.lockutils [None req-7ed880d0-6a8a-42e4-827e-f4213a736a7f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:57:21.565496 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG oslo_concurrency.lockutils [None req-7ed880d0-6a8a-42e4-827e-f4213a736a7f admin admin] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:57:21.565922 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG oslo_concurrency.lockutils [None req-7ed880d0-6a8a-42e4-827e-f4213a736a7f admin admin] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:57:21.599633 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-7ed880d0-6a8a-42e4-827e-f4213a736a7f admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.199955 Aug 03 12:57:21.600193 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 36/70] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Aug 3 12:57:21 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:57:22.428403 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-2f5b9785-0ccf-4061-a899-73ad7cfbaecb admin admin] Calling method '>' {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:57:22.429438 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-2f5b9785-0ccf-4061-a899-73ad7cfbaecb admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 03 12:57:22.429830 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 35/71] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Aug 3 12:57:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:57:22.618133 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-c4b096e8-8adc-4143-9a67-e2068134d711 admin admin] Calling method '>' {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:57:22.620551 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:57:22.620551 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: warnings.warn(msg) Aug 03 12:57:22.621768 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG oslo_concurrency.lockutils [None req-c4b096e8-8adc-4143-9a67-e2068134d711 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:57:22.622213 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG oslo_concurrency.lockutils [None req-c4b096e8-8adc-4143-9a67-e2068134d711 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:57:22.623027 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG oslo_concurrency.lockutils [None req-c4b096e8-8adc-4143-9a67-e2068134d711 admin admin] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:57:22.623494 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG oslo_concurrency.lockutils [None req-c4b096e8-8adc-4143-9a67-e2068134d711 admin admin] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:57:22.643335 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-c4b096e8-8adc-4143-9a67-e2068134d711 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075174 Aug 03 12:57:22.643900 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 37/72] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Aug 3 12:57:22 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:57:33.891190 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-2f5b9785-0ccf-4061-a899-73ad7cfbaecb admin admin] Calling method '>' {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:57:33.892209 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-2f5b9785-0ccf-4061-a899-73ad7cfbaecb admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001684 Aug 03 12:57:33.892603 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 36/73] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Aug 3 12:57:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:57:34.038906 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG dbcounter [-] [104420] Writing DB stats nova_cell0:SELECT=4 {{(pid=104420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:57:34.039787 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG dbcounter [-] [104420] Writing DB stats nova_cell1:SELECT=4 {{(pid=104420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:57:34.040395 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG dbcounter [-] [104420] Writing DB stats nova_api:SELECT=8 {{(pid=104420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:57:34.092159 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-c6523cbf-ce7f-495a-85af-1a377dc9bb1a admin admin] Calling method '>' {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:57:34.095294 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:57:34.095294 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: warnings.warn(msg) Aug 03 12:57:34.096526 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG oslo_concurrency.lockutils [None req-c6523cbf-ce7f-495a-85af-1a377dc9bb1a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:57:34.096971 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG oslo_concurrency.lockutils [None req-c6523cbf-ce7f-495a-85af-1a377dc9bb1a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:57:34.097760 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG oslo_concurrency.lockutils [None req-c6523cbf-ce7f-495a-85af-1a377dc9bb1a admin admin] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:57:34.098192 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG oslo_concurrency.lockutils [None req-c6523cbf-ce7f-495a-85af-1a377dc9bb1a admin admin] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:57:34.123293 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-c6523cbf-ce7f-495a-85af-1a377dc9bb1a admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.089034 Aug 03 12:57:34.123841 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 38/74] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Aug 3 12:57:34 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:57:34.945759 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: DEBUG nova.api.openstack.wsgi [None req-2f5b9785-0ccf-4061-a899-73ad7cfbaecb admin admin] Calling method '>' {{(pid=104419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:57:34.946944 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: INFO nova.api.openstack.requestlog [None req-2f5b9785-0ccf-4061-a899-73ad7cfbaecb admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Aug 03 12:57:34.947349 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: [pid: 104419|app: 0|req: 37/75] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Aug 3 12:57:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:57:35.138428 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG nova.api.openstack.wsgi [None req-10b089dc-6de6-4006-bcba-fd24c45ac34b admin admin] Calling method '>' {{(pid=104420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:57:35.140920 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:57:35.140920 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: warnings.warn(msg) Aug 03 12:57:35.142153 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG oslo_concurrency.lockutils [None req-10b089dc-6de6-4006-bcba-fd24c45ac34b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:57:35.142599 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG oslo_concurrency.lockutils [None req-10b089dc-6de6-4006-bcba-fd24c45ac34b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:57:35.143430 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG oslo_concurrency.lockutils [None req-10b089dc-6de6-4006-bcba-fd24c45ac34b admin admin] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:57:35.143992 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: DEBUG oslo_concurrency.lockutils [None req-10b089dc-6de6-4006-bcba-fd24c45ac34b admin admin] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:57:35.165680 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: INFO nova.api.openstack.requestlog [None req-10b089dc-6de6-4006-bcba-fd24c45ac34b admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079848 Aug 03 12:57:35.166240 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: [pid: 104420|app: 0|req: 39/76] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Aug 3 12:57:35 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:58:31.965191 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: Wed Aug 3 12:58:31 2022 - graceful shutdown triggered... Aug 03 12:58:31.964928 dv-cinder-850836-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 03 12:58:31.966182 dv-cinder-850836-4-iscsi devstack@n-api.service[104419]: Gracefully killing worker 1 (pid: 104419)... Aug 03 12:58:31.966774 dv-cinder-850836-4-iscsi devstack@n-api.service[104420]: Gracefully killing worker 2 (pid: 104420)... Aug 03 12:58:32.965948 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: worker 1 buried after 1 seconds Aug 03 12:58:32.966497 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: worker 2 buried after 1 seconds Aug 03 12:58:32.966497 dv-cinder-850836-4-iscsi devstack@n-api.service[104418]: goodbye to uWSGI. Aug 03 12:58:32.968139 dv-cinder-850836-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 03 12:58:32.968701 dv-cinder-850836-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 03 12:58:32.971467 dv-cinder-850836-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 03 12:58:32.984124 dv-cinder-850836-4-iscsi devstack@n-api.service[119394]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 03 12:58:32.986116 dv-cinder-850836-4-iscsi devstack@n-api.service[119394]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 3 12:58:32 2022] *** Aug 03 12:58:32.986116 dv-cinder-850836-4-iscsi devstack@n-api.service[119394]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 03 12:58:32.986116 dv-cinder-850836-4-iscsi devstack@n-api.service[119394]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 03 12:58:32.986116 dv-cinder-850836-4-iscsi devstack@n-api.service[119394]: nodename: dv-cinder-850836-4-iscsi Aug 03 12:58:32.986116 dv-cinder-850836-4-iscsi devstack@n-api.service[119394]: machine: x86_64 Aug 03 12:58:32.986116 dv-cinder-850836-4-iscsi devstack@n-api.service[119394]: clock source: unix Aug 03 12:58:32.986116 dv-cinder-850836-4-iscsi devstack@n-api.service[119394]: pcre jit disabled Aug 03 12:58:32.986116 dv-cinder-850836-4-iscsi devstack@n-api.service[119394]: detected number of CPU cores: 4 Aug 03 12:58:32.986116 dv-cinder-850836-4-iscsi devstack@n-api.service[119394]: current working directory: / Aug 03 12:58:32.986116 dv-cinder-850836-4-iscsi devstack@n-api.service[119394]: detected binary path: /usr/bin/uwsgi-core Aug 03 12:58:32.986917 dv-cinder-850836-4-iscsi devstack@n-api.service[119394]: your processes number limit is 47680 Aug 03 12:58:32.986917 dv-cinder-850836-4-iscsi devstack@n-api.service[119394]: your memory page size is 4096 bytes Aug 03 12:58:32.986917 dv-cinder-850836-4-iscsi devstack@n-api.service[119394]: detected max file descriptor number: 2048 Aug 03 12:58:32.986917 dv-cinder-850836-4-iscsi devstack@n-api.service[119394]: lock engine: pthread robust mutexes Aug 03 12:58:32.986917 dv-cinder-850836-4-iscsi devstack@n-api.service[119394]: thunder lock: enabled Aug 03 12:58:32.986917 dv-cinder-850836-4-iscsi devstack@n-api.service[119394]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 03 12:58:32.986917 dv-cinder-850836-4-iscsi devstack@n-api.service[119394]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 03 12:58:33.027096 dv-cinder-850836-4-iscsi devstack@n-api.service[119394]: Python main interpreter initialized at 0x5600eff189c0 Aug 03 12:58:33.027096 dv-cinder-850836-4-iscsi devstack@n-api.service[119394]: python threads support enabled Aug 03 12:58:33.027096 dv-cinder-850836-4-iscsi devstack@n-api.service[119394]: your server socket listen backlog is limited to 100 connections Aug 03 12:58:33.027096 dv-cinder-850836-4-iscsi devstack@n-api.service[119394]: your mercy for graceful operations on workers is 90 seconds Aug 03 12:58:33.027516 dv-cinder-850836-4-iscsi devstack@n-api.service[119394]: mapped 403077 bytes (393 KB) for 2 cores Aug 03 12:58:33.027516 dv-cinder-850836-4-iscsi devstack@n-api.service[119394]: *** Operational MODE: preforking *** Aug 03 12:58:33.027830 dv-cinder-850836-4-iscsi devstack@n-api.service[119394]: *** uWSGI is running in multiple interpreter mode *** Aug 03 12:58:33.027830 dv-cinder-850836-4-iscsi devstack@n-api.service[119394]: spawned uWSGI master process (pid: 119394) Aug 03 12:58:33.028039 dv-cinder-850836-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 03 12:58:33.030183 dv-cinder-850836-4-iscsi devstack@n-api.service[119394]: spawned uWSGI worker 1 (pid: 119409, cores: 1) Aug 03 12:58:33.030183 dv-cinder-850836-4-iscsi devstack@n-api.service[119394]: spawned uWSGI worker 2 (pid: 119410, cores: 1) Aug 03 12:58:33.030183 dv-cinder-850836-4-iscsi devstack@n-api.service[119394]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 03 12:58:33.701235 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 12:58:33.711951 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 12:58:34.854949 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 12:58:34.854949 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: from cryptography.utils import int_from_bytes Aug 03 12:58:34.855623 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 12:58:34.855623 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: from cryptography.utils import int_from_bytes Aug 03 12:58:34.873608 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 12:58:34.873608 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: from cryptography.utils import int_from_bytes Aug 03 12:58:34.874242 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 12:58:34.874242 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: from cryptography.utils import int_from_bytes Aug 03 12:58:37.250895 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 12:58:37.251449 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 12:58:37.251767 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 12:58:37.252057 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 12:58:37.252318 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 12:58:37.252712 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.253041 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.253366 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.253688 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.254023 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.254340 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.254672 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.255046 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.255378 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.255640 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.255959 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.256287 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850836-4-iscsi {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.256614 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.257094 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.257411 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.257735 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.258043 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.258382 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.258687 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.259223 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.260657 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.260657 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.260657 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.260657 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.260989 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.261212 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.261535 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.261848 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.262159 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.262481 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.263515 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850836-4-iscsi {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.263840 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.264156 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.264468 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.264888 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.265215 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.265513 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.265836 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.266162 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.266472 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.266845 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.267159 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.267481 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.267801 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.268099 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.268408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.268720 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.269046 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.269357 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.269483 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 12:58:37.269891 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.269976 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 12:58:37.270057 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.270248 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 12:58:37.270361 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.270526 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.270625 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 12:58:37.270833 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 12:58:37.270948 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.271191 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.271302 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.271515 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.271631 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.271790 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.271900 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.272067 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.272164 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.272393 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.272503 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.272707 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.272821 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.273021 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.273122 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.273333 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.273514 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.273668 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.273846 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.274008 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.274162 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.274318 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.274473 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.274635 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.274864 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850836-4-iscsi {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.275037 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.275191 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.275338 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.275495 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.275663 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.275822 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.275978 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.276131 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.276278 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.276424 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.276580 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.276726 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.276882 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.277033 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.277033 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.277318 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.277490 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.277638 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.277792 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.277946 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.278183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.278384 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.278571 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.278772 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.278925 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.279105 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.279269 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.279451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.279607 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.279783 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.279932 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.280108 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.280265 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.280543 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.280705 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.280853 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.281010 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850836-4-iscsi {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.281165 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.281322 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.281469 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.281622 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.281777 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.281924 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.282077 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.282077 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.282906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.282906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.283208 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.283622 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.283798 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.283956 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.284115 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.284261 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.284483 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.284483 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.284783 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.284933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.285085 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.285231 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.285376 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.285521 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.285696 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.285845 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.285991 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.286147 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.286300 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.286462 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.286616 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.286805 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.286958 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.287112 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.287258 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.287413 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.287567 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.287724 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.287881 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.287881 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.288175 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.288379 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.288531 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.288684 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.288841 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.288995 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.289142 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.289142 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.289444 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.289444 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.289761 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.289909 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.290109 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.290288 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.290438 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.290598 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.290598 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.290927 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.291074 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.291222 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.291381 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.291557 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.291704 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.291857 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.292014 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.292180 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.292357 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.293011 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.293168 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.293316 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.293470 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.293624 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.293781 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.293959 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.294121 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.294267 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.294413 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.294656 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.294862 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.295019 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.295173 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.295320 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.295320 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.295609 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.295766 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.295921 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.296068 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.296227 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.296381 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.296539 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.296696 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.296854 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.297008 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.297168 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.297316 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.297472 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.297619 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.297772 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.297939 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.298699 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.298896 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.299059 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.299206 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.299352 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.299506 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.299661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.299808 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.299963 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.300110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.300266 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.300266 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.300559 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.300725 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.300881 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.301028 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.301182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.301341 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.301494 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.301656 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.301803 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.301956 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.302122 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.302277 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.302431 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.302609 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.303344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.303509 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.303657 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.303803 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.303955 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.304119 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.304267 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.304412 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.304557 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.304799 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.304959 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.305120 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.305120 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.305410 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.305556 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.305700 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.305860 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.306018 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.306164 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.306309 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.306455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.306600 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.306774 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.306940 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.307094 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.307264 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.307420 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.307567 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.307722 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.307869 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.308022 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.308178 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.308324 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.308469 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.308625 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.308821 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.308981 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.309138 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.309295 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.309449 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.310103 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.310251 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.310405 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.310574 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.310722 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.310914 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.311060 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.311214 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.311442 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.311591 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.311745 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.311912 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.312076 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.312224 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.312383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.312383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.312662 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.312836 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.313505 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.313671 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.313832 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.313978 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.314132 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.314289 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.314456 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.314610 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.314782 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.315016 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.315177 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.315375 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.315532 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.315686 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.315832 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.315991 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.316139 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.316293 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.316448 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.316612 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.316796 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.316960 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.317119 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.317265 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.317419 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.317564 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:58:37.317724 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.317877 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.318024 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.318176 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.318331 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.318495 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.318661 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.318885 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.319038 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.319184 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.319339 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.319495 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.319657 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.319810 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.319964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.319964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.320248 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.320403 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.320566 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.320721 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.320875 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.321022 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.321167 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.321326 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.321479 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.321627 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.321781 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.321927 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.322090 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.322247 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.322404 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.322550 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.322705 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.322907 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.323073 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.323757 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.324056 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.324210 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.324357 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.324503 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.324663 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.324819 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.324993 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.325280 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.325936 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.326092 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.326249 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.326396 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.326542 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.326687 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.326861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.327019 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.327176 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.327324 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.327477 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.327631 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.327796 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.327956 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.328115 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.328262 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.328408 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.328554 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.328699 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.328859 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.329056 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.329210 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.329356 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.329510 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.329666 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.329834 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.329990 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.330137 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.330291 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.330445 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.330600 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.330814 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.330968 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.331115 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.331260 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.331406 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.331563 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.331734 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.331890 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.332045 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.332203 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.332349 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.332510 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.332657 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.332802 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.332959 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.333117 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.333264 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.333959 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.334197 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.334362 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.334508 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.334654 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.334822 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.334989 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.335138 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.335383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.335544 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.335691 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.335837 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.335998 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.336147 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.336300 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.336300 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.336606 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.336767 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.336915 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.337061 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.337215 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.337215 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.337215 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.337645 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.337793 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.337939 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.338085 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.338230 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.338387 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.338543 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.338702 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.338702 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.338702 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.338702 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.338702 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.338702 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.338702 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.338702 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.339967 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.339967 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.339967 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.339967 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.340612 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.340797 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.340958 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.341116 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.341279 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.341425 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.341572 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.341725 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.341879 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.342039 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.342039 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.342346 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.342493 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.342646 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.342813 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.342963 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.343121 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.343279 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.343433 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.344093 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.344341 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.344494 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.344658 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.344817 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.344982 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.345228 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.345419 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.345654 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.345807 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.345962 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.346117 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.346271 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.346426 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.346583 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.346762 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.346915 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.347062 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.347229 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.347376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.347532 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.347679 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.347825 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.347982 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.348135 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.348281 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.348435 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.348583 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.348727 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.348886 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.349032 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.349252 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.349400 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.349553 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.349699 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.349845 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.349999 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.350154 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.350300 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.350453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.350607 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.350774 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.350926 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.351104 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.351251 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.351397 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.351550 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.351697 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.351842 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.352096 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.352254 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.352412 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.352567 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.352728 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.352896 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.353050 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.353213 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.353365 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.353515 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.353679 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.354166 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.354585 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.354772 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.354944 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.355105 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.355267 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.355429 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.355583 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.355823 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.355823 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.356140 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.356302 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.356302 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.357123 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.357277 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.357424 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.357568 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.357729 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.357890 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.358045 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.358191 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.358345 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.358502 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.358663 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.358858 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.359005 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.359198 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.359363 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.359509 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.359671 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.359826 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.359980 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.360126 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.360279 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.360426 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.360596 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.360752 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.360898 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.361051 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.361197 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.361342 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.361498 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.361653 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.361807 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.361961 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.362126 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.362283 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.362447 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.362606 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.362779 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.362943 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.363123 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.363345 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.363504 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.363660 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.363806 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.364265 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.364446 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.364867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.365031 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.365197 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.365345 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.365497 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.365653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.365828 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.366059 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.366211 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.366211 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.366505 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.366667 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.366850 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.366999 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.367145 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.367301 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.367447 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.367602 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.367758 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.367913 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.368067 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.368223 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.368370 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.368524 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.368672 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.368826 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.368988 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.369149 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.369367 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.369534 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.369689 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.369850 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.370014 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.370167 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.370328 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.370488 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.370641 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.370866 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.371107 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.371263 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.371432 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.371593 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.371746 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.371908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.375529 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.375723 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.375886 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.376071 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.376309 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.376481 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.376636 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.376796 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.376956 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.377130 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.377284 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.377451 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.377604 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.377756 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.377910 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.378078 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.378233 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.378395 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.378556 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.378796 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.378972 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.379133 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.379312 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.379525 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.379679 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.379839 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.380000 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.380153 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.380316 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.380470 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.380631 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.380784 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.380945 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.381099 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.381265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.381432 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.381585 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.381745 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.381899 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.382050 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.382216 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.382379 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.382532 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.382699 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.382889 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.383058 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.383213 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.383385 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.383550 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.383705 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.383857 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.384019 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.384172 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.384333 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.384496 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.384649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.384801 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.384981 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.385656 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.385812 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.385988 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.386150 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.386330 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.386566 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.386726 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.386903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.387068 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.387230 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.387384 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.387550 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.387739 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.387895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.388048 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.388211 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.388375 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.388529 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.388683 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.388836 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.388996 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.389149 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.389315 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.389529 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.389689 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.389851 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.390005 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.390155 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.390290 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.390411 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.390506 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.390506 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.390669 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.390790 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.390935 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.391067 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.391206 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.391338 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.391468 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.391607 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.391747 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.391888 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.392028 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.392167 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.392305 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.392447 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.392579 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.392723 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.392723 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.392982 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.393124 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.393267 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.393400 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.393532 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.393679 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.393813 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.393966 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.394099 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.394231 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.394363 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.394363 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.394625 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.394794 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.394929 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.395061 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.395712 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.395866 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.396004 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.396146 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.396280 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.396421 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.396577 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.396793 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.396938 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.397081 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.397222 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.397355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.397497 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.397637 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.397779 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.397921 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.398056 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.398196 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.398374 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.398509 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.398655 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.398816 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.398950 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.399082 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.399234 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.399369 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.399550 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.399685 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.399827 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.399967 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.400111 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.400246 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.400378 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.400378 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.400639 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.400639 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.400639 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.400639 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.400639 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.400639 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.401385 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.401532 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.401532 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.401789 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.401922 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.401922 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.402170 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.402316 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.402316 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.402591 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.402727 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.402895 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.403039 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.403039 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.403325 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.403460 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.403460 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.403719 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.403866 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.403866 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.404127 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.404259 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.404402 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.404534 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.404744 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.404889 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.404889 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.405149 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.405852 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.406006 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.406151 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.406151 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.406421 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.406563 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.406563 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.406920 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.407075 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.407218 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.407351 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.407351 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.407351 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.407742 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.407876 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.408008 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.408139 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.408139 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.408650 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.408792 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.408792 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.409053 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.409193 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.409193 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.409460 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.409647 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.409647 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.409901 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.410032 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.410032 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.410297 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.410443 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.410584 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.410717 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.410717 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.411038 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.411184 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.411184 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.411443 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.411587 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.411720 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.411862 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.411862 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.412199 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.412331 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.412464 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.412603 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.412747 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.412891 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.412891 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.413162 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.413296 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.413296 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.413552 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.413698 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.413842 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.413974 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.413974 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.414223 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.414369 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.414510 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.414650 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.414650 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.414931 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.415071 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.415071 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.415337 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.415483 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.415483 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.416247 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.416380 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.416528 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.416662 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.416662 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.417190 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.417334 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.417334 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.417604 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.417738 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.417738 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.417995 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.418130 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.418130 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.418403 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.418537 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.418537 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.418812 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.419583 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.419819 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.419960 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.419960 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.420219 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.420356 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.420356 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.420619 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.420748 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.420883 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.421019 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.421019 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.421271 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.421408 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.421545 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.421682 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.421682 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.421924 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.422052 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.422189 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.422320 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.422320 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.422561 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.422695 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.422695 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.423018 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.423147 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.423284 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.423420 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.423420 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.423677 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.423813 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.423813 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.424063 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.424191 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.424191 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.424443 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.424643 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.424788 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.424927 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.424927 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.425180 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.425310 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.425310 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.425562 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.426287 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.426287 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.426526 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.426638 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.426638 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.438147 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.438302 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.438437 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.438584 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.438584 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.438917 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.439049 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.439049 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.439305 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.439446 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.439446 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.439703 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.439830 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.440011 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.440156 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.440293 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.440429 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.440558 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.440685 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.440813 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.440953 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.441083 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.441211 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.441211 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.441459 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.441459 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.441710 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.441710 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.442038 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.442167 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.442304 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.442304 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.442564 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.442700 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.442859 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.442989 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.443124 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.443269 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.443408 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.443558 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.443695 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.443824 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.444037 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.444170 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.444909 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.445061 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.445192 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.445345 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.445560 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.445560 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.445832 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.446315 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.446567 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.446807 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.446959 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.447089 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.447229 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.447366 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.447582 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.447714 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.447844 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.447973 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.448119 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.448261 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.448399 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.448537 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.448667 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.448806 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.448943 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.449071 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.449199 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.449327 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.449455 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.449455 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.449712 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.449849 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.450020 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.450150 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.450279 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.450422 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.450553 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.450681 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.450842 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.450972 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.451129 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.451129 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.451376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.451504 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.451633 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.451760 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.451760 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.451760 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.452322 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.452453 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.452453 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.452714 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.452858 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.452996 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.453125 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.453125 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.453379 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.453507 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.453507 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.453769 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.453906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.453906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.454150 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.454287 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.454417 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.454558 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.454558 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.454828 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.454968 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.454968 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.455224 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.455359 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.455496 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.455625 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.455625 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.455878 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.456008 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.456576 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.456827 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.457047 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.457181 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.457181 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.457681 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.457828 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.457828 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.458093 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.458233 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.458233 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.458502 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.458647 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.458799 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.459090 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.459090 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.459365 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.459493 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.459493 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.459738 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.459826 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.459826 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.460021 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.460115 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.460206 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.460338 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.460338 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.460509 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.460601 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.460601 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.460760 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.460844 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.460940 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.461033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.461033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.461193 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.461282 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.461365 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.461455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.461455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.461617 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.461701 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.461701 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.461850 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.461945 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.462035 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.462140 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.462140 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.462296 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.462377 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.462377 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.462539 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.462621 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.462703 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.462804 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.462804 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.462973 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.463056 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.463138 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.463220 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.463220 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.463220 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.463445 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.463535 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.463618 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.463700 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.463789 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.463881 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.463881 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.464052 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.464144 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.464216 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.464299 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.464299 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.464461 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.464545 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.464627 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.464719 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.464812 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.464896 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.464986 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.465076 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.465167 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.465259 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.465351 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.465435 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.465524 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.465607 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.465689 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.465771 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.465862 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.465945 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.466034 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.466124 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.466233 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.466586 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.466694 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.466946 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.467059 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.467181 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.468598 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.468794 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.468891 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.468976 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.469067 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.469158 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.469158 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.469332 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.469332 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.469485 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.469584 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.469669 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.469760 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.469845 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.469938 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.470029 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.470120 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.470204 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.470295 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.470379 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.470470 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.470560 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.470652 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.470763 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.470864 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.470950 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.471041 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.471126 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.471217 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.471315 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.471401 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.471484 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.471567 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.471649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.471739 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.471836 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.471928 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.472020 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.472111 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.472195 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.472279 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.472377 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.472469 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.472564 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.472649 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.472731 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.472823 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.472915 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.473000 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.473000 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.473159 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.473260 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.473373 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.473468 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.473560 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.473645 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.473727 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.473809 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.473900 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.473985 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.474067 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.474150 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.474233 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.474328 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.474421 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.474530 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.474617 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.474707 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.474837 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.474921 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.475097 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.475192 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.475411 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.475509 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.475722 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.475824 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.476048 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.476149 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.476365 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.476648 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.476812 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.476903 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.477049 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.477231 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.477324 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.477680 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.477808 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.478012 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.478161 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.478334 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.478510 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.478663 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.478865 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.479198 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.479521 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.479626 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.479830 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.479943 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.480145 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.480260 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.480451 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.480579 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.480765 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.480880 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.481079 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.481186 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.481905 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.482018 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.482222 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.482333 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.482530 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.482638 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.482868 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.482971 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.483229 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.483343 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.483567 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.483769 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.483871 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.484126 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.484234 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.484456 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.484565 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.484781 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.484888 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.485120 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.485235 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.485437 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.485539 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.485750 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.485855 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.486137 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.486287 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.486453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.486598 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.486882 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.487213 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.487335 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.487527 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.487632 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.487869 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.487991 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.488174 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.488310 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.488570 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.488780 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.488889 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.489093 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.489201 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.489412 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.489512 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.489722 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.489822 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.490035 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.490151 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.490347 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.490488 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.490676 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.490800 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.491016 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.491143 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.491381 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.491466 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.491805 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.492125 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.492293 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.492387 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.492387 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.492567 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.492653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.492768 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.492938 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.493116 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.493245 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.493469 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.493569 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.493789 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.493888 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.494150 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.494341 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.494458 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.494680 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.494834 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.495039 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.495199 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.495375 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.495469 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.495705 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.495855 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.496051 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.496157 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.496358 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.496454 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.496665 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.496766 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.497019 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.497748 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.497895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.497994 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.498146 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.498246 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.498457 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.498574 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.498788 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.498928 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.499102 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.499414 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.499523 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.499727 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.499820 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.500038 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.500129 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.500347 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.500440 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.500657 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.500749 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.500966 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.501057 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.501280 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.501382 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.501589 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.501689 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.501932 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.502045 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.502242 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.502334 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.502554 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.502647 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.502890 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.502997 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.503204 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.503304 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.503515 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.503608 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.503825 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.503936 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.504136 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.504226 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.504444 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.504533 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.504752 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.504858 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.505064 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.505157 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.505371 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.505462 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.505678 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.505783 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.505985 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.506077 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.506294 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.506392 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.506607 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.506722 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.506977 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.507112 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.507291 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.507387 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.507620 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.507721 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.507934 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.508055 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.508258 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.508374 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.508567 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.508662 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.508882 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.508987 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.509203 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.509306 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.509511 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.509603 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.509830 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.509922 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.510160 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.510267 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.510474 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.510574 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.510840 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.510942 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.511122 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.511229 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.511429 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.511522 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.511736 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.511837 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.512048 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.512159 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.512367 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.512468 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.512714 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.512810 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.513025 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.513125 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.513334 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.513428 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.513646 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.513741 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.513982 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.514082 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.514310 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.514402 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.514616 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.514706 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.520324 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.520424 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.520507 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.520600 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.520685 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.520766 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.520859 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.520951 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.521035 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.521118 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.521207 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.521300 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.521386 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.521469 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.521559 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.521650 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.521742 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.521840 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.521925 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.522015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.522117 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.522204 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.522296 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.522381 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.522463 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.522546 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.522636 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.522727 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.522886 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.522982 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.523066 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.523157 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.523255 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.523346 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.523444 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.523529 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.523529 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.523679 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.523771 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.523863 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.523961 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.524047 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.524136 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.524227 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.524317 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.524410 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.524501 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.524586 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.524668 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.524758 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.524849 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.524954 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.525084 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.525175 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.525260 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.525350 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.525435 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.525532 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.525618 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.525701 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.525791 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.525876 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.525959 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.526204 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.526311 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.526397 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.526481 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.526564 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.526663 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.526812 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.526902 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.526997 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.527083 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.527324 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.527428 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.527523 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.527609 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.527699 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.527787 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.527871 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.527964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.528062 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.528174 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.528284 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.528379 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.528478 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.528741 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.528833 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.528917 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.529008 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.529093 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.529190 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.529276 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.529359 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.529442 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.529570 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.529672 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.529767 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.529853 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.529935 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.530146 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.530276 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.530466 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.530607 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.530800 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.530960 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.531115 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.531279 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.531443 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.531607 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.531753 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.531934 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.532064 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.532285 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.532389 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.532603 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.532696 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.532950 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.533050 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.533512 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.533623 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.533830 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.533929 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.534141 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.534233 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.534444 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.534547 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.534688 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 12:58:37.534797 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.535103 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.535430 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.535775 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.536108 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.536480 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.536782 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.537098 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.537451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.537768 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.538085 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.538400 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.538706 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:58:37.538975 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 12:58:37.597056 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO dbcounter [None req-c554f9a4-0de7-489b-8ec0-281af3f92fa7 None None] Registered counter for database nova_api Aug 03 12:58:37.600186 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO dbcounter [None req-19d92681-d665-42de-93a1-1634c51f9ea8 None None] Registered counter for database nova_api Aug 03 12:58:37.617665 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_db.sqlalchemy.engines [None req-c554f9a4-0de7-489b-8ec0-281af3f92fa7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:58:37.620235 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_db.sqlalchemy.engines [None req-19d92681-d665-42de-93a1-1634c51f9ea8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:58:37.625383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writer thread running {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:58:37.627606 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writer thread running {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:58:37.681229 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.context [None req-c554f9a4-0de7-489b-8ec0-281af3f92fa7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d7258eba-25ec-4b0b-9efc-0af1d93beccb(cell1) {{(pid=119410) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 12:58:37.682543 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.context [None req-19d92681-d665-42de-93a1-1634c51f9ea8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d7258eba-25ec-4b0b-9efc-0af1d93beccb(cell1) {{(pid=119409) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 12:58:37.685982 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c554f9a4-0de7-489b-8ec0-281af3f92fa7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:58:37.687258 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-19d92681-d665-42de-93a1-1634c51f9ea8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:58:37.687607 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c554f9a4-0de7-489b-8ec0-281af3f92fa7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:58:37.688407 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c554f9a4-0de7-489b-8ec0-281af3f92fa7 None None] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:58:37.688854 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-19d92681-d665-42de-93a1-1634c51f9ea8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:58:37.689657 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-19d92681-d665-42de-93a1-1634c51f9ea8 None None] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:58:37.690386 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c554f9a4-0de7-489b-8ec0-281af3f92fa7 None None] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:58:37.691667 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-19d92681-d665-42de-93a1-1634c51f9ea8 None None] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:58:37.692454 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO dbcounter [None req-c554f9a4-0de7-489b-8ec0-281af3f92fa7 None None] Registered counter for database nova_cell0 Aug 03 12:58:37.693660 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO dbcounter [None req-19d92681-d665-42de-93a1-1634c51f9ea8 None None] Registered counter for database nova_cell0 Aug 03 12:58:37.696788 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO dbcounter [None req-c554f9a4-0de7-489b-8ec0-281af3f92fa7 None None] Registered counter for database nova_cell1 Aug 03 12:58:37.697757 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO dbcounter [None req-19d92681-d665-42de-93a1-1634c51f9ea8 None None] Registered counter for database nova_cell1 Aug 03 12:58:37.704161 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_db.sqlalchemy.engines [None req-c554f9a4-0de7-489b-8ec0-281af3f92fa7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:58:37.707807 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_db.sqlalchemy.engines [None req-19d92681-d665-42de-93a1-1634c51f9ea8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:58:37.708578 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_db.sqlalchemy.engines [None req-19d92681-d665-42de-93a1-1634c51f9ea8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:58:37.709695 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_db.sqlalchemy.engines [None req-c554f9a4-0de7-489b-8ec0-281af3f92fa7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:58:37.712789 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writer thread running {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:58:37.715347 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writer thread running {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:58:37.717919 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writer thread running {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:58:37.855351 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writer thread running {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:58:37.863405 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO dbcounter [None req-19d92681-d665-42de-93a1-1634c51f9ea8 None None] Registered counter for database nova_cell0 Aug 03 12:58:37.865623 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO dbcounter [None req-c554f9a4-0de7-489b-8ec0-281af3f92fa7 None None] Registered counter for database nova_cell0 Aug 03 12:58:37.870336 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_db.sqlalchemy.engines [None req-19d92681-d665-42de-93a1-1634c51f9ea8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:58:37.874935 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writer thread running {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:58:37.876200 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_db.sqlalchemy.engines [None req-c554f9a4-0de7-489b-8ec0-281af3f92fa7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:58:37.880729 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writer thread running {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:58:38.196963 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: WARNING keystonemiddleware.auth_token [None req-19d92681-d665-42de-93a1-1634c51f9ea8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 12:58:38.204705 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: WARNING keystonemiddleware.auth_token [None req-c554f9a4-0de7-489b-8ec0-281af3f92fa7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 12:58:38.205487 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: WARNING keystonemiddleware.auth_token [None req-19d92681-d665-42de-93a1-1634c51f9ea8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 12:58:38.211960 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: WARNING keystonemiddleware.auth_token [None req-c554f9a4-0de7-489b-8ec0-281af3f92fa7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 12:58:38.549999 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: WARNING keystonemiddleware.auth_token [None req-19d92681-d665-42de-93a1-1634c51f9ea8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 12:58:38.556160 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: WARNING keystonemiddleware.auth_token [None req-19d92681-d665-42de-93a1-1634c51f9ea8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 12:58:38.559424 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: WARNING keystonemiddleware.auth_token [None req-c554f9a4-0de7-489b-8ec0-281af3f92fa7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 12:58:38.561530 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5600eff189c0 pid: 119409 (default app) Aug 03 12:58:38.565402 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: WARNING keystonemiddleware.auth_token [None req-c554f9a4-0de7-489b-8ec0-281af3f92fa7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 12:58:38.570707 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5600eff189c0 pid: 119410 (default app) Aug 03 12:59:20.195057 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=3 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:20.196696 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=3 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:20.197892 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell0:SELECT=3 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:20.200268 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell0:SELECT=3 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:20.937539 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=3 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:20.939047 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=3 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:20.940026 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=3 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:20.941213 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=3 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:21.599781 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d2f2448c-7a99-48c8-b29e-6f522b19a268 tempest-VolumesNegativeTest-1358784730 tempest-VolumesNegativeTest-1358784730-project] Action: 'create', calling method: .version_select at 0x7fe6da1e9700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1728412273", "metadata": {"Type": "work"}}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:59:21.614772 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d2f2448c-7a99-48c8-b29e-6f522b19a268 tempest-VolumesNegativeTest-1358784730 tempest-VolumesNegativeTest-1358784730-project] Request method failure captured: Aug 03 12:59:21.614772 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 03 12:59:21.614772 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 12:59:21.614772 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 12:59:21.614772 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 12:59:21.614772 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 122 Aug 03 12:59:21.614772 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 12:59:21.614772 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 12:59:21.614772 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 12:59:21.614772 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 12:59:21.614772 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nEoucpxSQUvSiSmYBnQNGZ4rzfNQpqSk2nVHYS_k4gJuwwcUUaaR3RjVlve8H4_N2ZMXDirvQfc2hJBC2YOWDYCw3PXjaQhyn30ffh1_6AxlnNoOqdg8axSPxld9MxSAs23UyO_41dxTsrLalMlFIKLlaQprxr_xgR5ByoAFwIi1BA Aug 03 12:59:21.614772 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 12:59:21.614772 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 12:59:21.614772 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 12:59:21.614772 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 12:59:21.614772 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 12:59:21.614772 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 12:59:21.614772 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: e20045ed345344aa827297413436e734 Aug 03 12:59:21.614772 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-VolumesNegativeTest-1358784730 Aug 03 12:59:21.614772 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 12:59:21.614772 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 12:59:21.616707 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e20045ed345344aa827297413436e734"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e20045ed345344aa827297413436e734"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e20045ed345344aa827297413436e734"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e20045ed345344aa827297413436e734", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 12:59:21.616707 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-VolumesNegativeTest-1358784730 Aug 03 12:59:21.616707 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: e20045ed345344aa827297413436e734 Aug 03 12:59:21.616707 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-VolumesNegativeTest-1358784730 Aug 03 12:59:21.616707 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-VolumesNegativeTest-1358784730-project Aug 03 12:59:21.616707 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 12:59:21.616707 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 12:59:21.616707 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: cd605450595c446e887edf13518f542b Aug 03 12:59:21.616707 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-VolumesNegativeTest-1358784730-project Aug 03 12:59:21.616707 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Aug 03 12:59:21.616707 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1728412273", "metadata": {"Type": "work"}}} Aug 03 12:59:21.616707 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: Aug 03 12:59:21.616707 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 03 12:59:21.617639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1728412273', 'metadata': {'Type': 'work'}}}} Aug 03 12:59:21.617639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:59:21.617639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:59:21.617639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 12:59:21.617639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 12:59:21.617639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 12:59:21.617639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise error Aug 03 12:59:21.617639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 03 12:59:21.617639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:21.617639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 03 12:59:21.617639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 03 12:59:21.617639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:21.617639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 03 12:59:21.617639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi '#$%' Aug 03 12:59:21.617639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:21.617639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:59:21.617639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:21.617639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:59:21.617639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:59:21.617639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:59:21.617639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:59:21.617639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:59:21.620504 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 12:59:21.620504 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 12:59:21.620504 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:59:21.620504 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:59:21.620504 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 12:59:21.620504 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 12:59:21.620504 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 12:59:21.620504 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 12:59:21.620504 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 12:59:21.620504 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 12:59:21.620504 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 03 12:59:21.620504 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:21.620504 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:59:21.620504 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:21.620504 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:59:21.620504 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:59:21.620504 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:59:21.620504 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 12:59:21.620504 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 12:59:21.635584 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 03 12:59:21.635584 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:21.635584 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d2f2448c-7a99-48c8-b29e-6f522b19a268 tempest-VolumesNegativeTest-1358784730 tempest-VolumesNegativeTest-1358784730-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:59:21.635584 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-d2f2448c-7a99-48c8-b29e-6f522b19a268 tempest-VolumesNegativeTest-1358784730 tempest-VolumesNegativeTest-1358784730-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.451031 Aug 03 12:59:21.635584 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 1/1] 10.222.0.64 () {60 vars in 1156 bytes} [Wed Aug 3 12:59:20 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1455 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 12:59:21.644829 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-5ccf9a81-336d-44eb-a8b3-dddfb6ca7b87 tempest-VolumesNegativeTest-1358784730 tempest-VolumesNegativeTest-1358784730-project] Action: 'create', calling method: .version_select at 0x7fe6da1e9790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2106282603", "metadata": {"Type": "work"}}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:59:21.648880 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-5ccf9a81-336d-44eb-a8b3-dddfb6ca7b87 tempest-VolumesNegativeTest-1358784730 tempest-VolumesNegativeTest-1358784730-project] Request method failure captured: Aug 03 12:59:21.648880 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 03 12:59:21.648880 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 12:59:21.648880 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 12:59:21.648880 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 12:59:21.648880 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 120 Aug 03 12:59:21.648880 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 12:59:21.648880 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 12:59:21.648880 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 12:59:21.648880 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 12:59:21.648880 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nEoucpxSQUvSiSmYBnQNGZ4rzfNQpqSk2nVHYS_k4gJuwwcUUaaR3RjVlve8H4_N2ZMXDirvQfc2hJBC2YOWDYCw3PXjaQhyn30ffh1_6AxlnNoOqdg8axSPxld9MxSAs23UyO_41dxTsrLalMlFIKLlaQprxr_xgR5ByoAFwIi1BA Aug 03 12:59:21.648880 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 12:59:21.648880 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 12:59:21.648880 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 12:59:21.648880 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 12:59:21.648880 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 12:59:21.648880 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 12:59:21.648880 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: e20045ed345344aa827297413436e734 Aug 03 12:59:21.648880 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-VolumesNegativeTest-1358784730 Aug 03 12:59:21.648880 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 12:59:21.648880 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 12:59:21.650174 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e20045ed345344aa827297413436e734"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e20045ed345344aa827297413436e734"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e20045ed345344aa827297413436e734"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e20045ed345344aa827297413436e734", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 12:59:21.650174 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-VolumesNegativeTest-1358784730 Aug 03 12:59:21.650174 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: e20045ed345344aa827297413436e734 Aug 03 12:59:21.650174 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-VolumesNegativeTest-1358784730 Aug 03 12:59:21.650174 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-VolumesNegativeTest-1358784730-project Aug 03 12:59:21.650174 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 12:59:21.650174 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 12:59:21.650174 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: cd605450595c446e887edf13518f542b Aug 03 12:59:21.650174 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-VolumesNegativeTest-1358784730-project Aug 03 12:59:21.650174 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Aug 03 12:59:21.650174 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2106282603", "metadata": {"Type": "work"}}} Aug 03 12:59:21.650174 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: Aug 03 12:59:21.650174 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 03 12:59:21.651110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2106282603', 'metadata': {'Type': 'work'}}}} Aug 03 12:59:21.651110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:59:21.651110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:59:21.651110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 12:59:21.651110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 12:59:21.651110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 12:59:21.651110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise error Aug 03 12:59:21.651110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 03 12:59:21.651110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:21.651110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 03 12:59:21.651110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 03 12:59:21.651110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:21.651110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 03 12:59:21.651110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi '0' Aug 03 12:59:21.651110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:21.651110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:59:21.651110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:21.651110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:59:21.651110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:59:21.651110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:59:21.651110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:59:21.651110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:59:21.652597 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 12:59:21.652597 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 12:59:21.652597 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:59:21.652597 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:59:21.652597 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 12:59:21.652597 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 12:59:21.652597 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 12:59:21.652597 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 12:59:21.652597 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 12:59:21.652597 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 12:59:21.652597 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 03 12:59:21.652597 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:21.652597 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:59:21.652597 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:21.652597 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:59:21.652597 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:59:21.652597 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:59:21.652597 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 12:59:21.652597 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 12:59:21.653654 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 03 12:59:21.653654 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:21.655365 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-5ccf9a81-336d-44eb-a8b3-dddfb6ca7b87 tempest-VolumesNegativeTest-1358784730 tempest-VolumesNegativeTest-1358784730-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:59:21.656505 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-5ccf9a81-336d-44eb-a8b3-dddfb6ca7b87 tempest-VolumesNegativeTest-1358784730 tempest-VolumesNegativeTest-1358784730-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018072 Aug 03 12:59:21.664197 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 2/2] 10.222.0.64 () {60 vars in 1156 bytes} [Wed Aug 3 12:59:21 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 12:59:21.671252 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-33c506e0-67a2-4599-a762-1754eea72810 tempest-VolumesNegativeTest-1358784730 tempest-VolumesNegativeTest-1358784730-project] Action: 'create', calling method: .version_select at 0x7fe6da0a6280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1428262524", "metadata": {"Type": "work"}}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:59:21.676130 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-33c506e0-67a2-4599-a762-1754eea72810 tempest-VolumesNegativeTest-1358784730 tempest-VolumesNegativeTest-1358784730-project] Request method failure captured: Aug 03 12:59:21.676130 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 03 12:59:21.676130 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 12:59:21.676130 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 12:59:21.676130 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 12:59:21.676130 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 119 Aug 03 12:59:21.676130 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 12:59:21.676130 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 12:59:21.676130 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 12:59:21.676130 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 12:59:21.676130 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nEoucpxSQUvSiSmYBnQNGZ4rzfNQpqSk2nVHYS_k4gJuwwcUUaaR3RjVlve8H4_N2ZMXDirvQfc2hJBC2YOWDYCw3PXjaQhyn30ffh1_6AxlnNoOqdg8axSPxld9MxSAs23UyO_41dxTsrLalMlFIKLlaQprxr_xgR5ByoAFwIi1BA Aug 03 12:59:21.676130 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 12:59:21.676130 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 12:59:21.676130 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 12:59:21.676130 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 12:59:21.676130 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 12:59:21.676130 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 12:59:21.676130 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: e20045ed345344aa827297413436e734 Aug 03 12:59:21.676130 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-VolumesNegativeTest-1358784730 Aug 03 12:59:21.676130 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 12:59:21.676130 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 12:59:21.677416 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e20045ed345344aa827297413436e734"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e20045ed345344aa827297413436e734"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e20045ed345344aa827297413436e734"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e20045ed345344aa827297413436e734", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 12:59:21.677416 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-VolumesNegativeTest-1358784730 Aug 03 12:59:21.677416 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: e20045ed345344aa827297413436e734 Aug 03 12:59:21.677416 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-VolumesNegativeTest-1358784730 Aug 03 12:59:21.677416 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-VolumesNegativeTest-1358784730-project Aug 03 12:59:21.677416 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 12:59:21.677416 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 12:59:21.677416 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: cd605450595c446e887edf13518f542b Aug 03 12:59:21.677416 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-VolumesNegativeTest-1358784730-project Aug 03 12:59:21.677416 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Aug 03 12:59:21.677416 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1428262524", "metadata": {"Type": "work"}}} Aug 03 12:59:21.677416 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: Aug 03 12:59:21.677416 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 03 12:59:21.678182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1428262524', 'metadata': {'Type': 'work'}}}} Aug 03 12:59:21.678182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:59:21.678182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:59:21.678182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 12:59:21.678182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 12:59:21.678182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 12:59:21.678182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise error Aug 03 12:59:21.678182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 03 12:59:21.678182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:21.678182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 03 12:59:21.678182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 03 12:59:21.678182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:21.678182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 03 12:59:21.678182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi '' Aug 03 12:59:21.678182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:21.678182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:59:21.678182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:21.678182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:59:21.678182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:59:21.678182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:59:21.678182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:59:21.678182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:59:21.679499 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 12:59:21.679499 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 12:59:21.679499 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:59:21.679499 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:59:21.679499 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 12:59:21.679499 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 12:59:21.679499 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 12:59:21.679499 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 12:59:21.679499 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 12:59:21.679499 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 12:59:21.679499 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 03 12:59:21.679499 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:21.679499 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:59:21.679499 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:21.679499 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:59:21.679499 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:59:21.679499 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:59:21.679499 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 12:59:21.679499 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 12:59:21.680569 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 03 12:59:21.680569 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:21.682949 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-33c506e0-67a2-4599-a762-1754eea72810 tempest-VolumesNegativeTest-1358784730 tempest-VolumesNegativeTest-1358784730-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:59:21.684231 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-33c506e0-67a2-4599-a762-1754eea72810 tempest-VolumesNegativeTest-1358784730 tempest-VolumesNegativeTest-1358784730-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018348 Aug 03 12:59:21.691007 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 3/3] 10.222.0.64 () {60 vars in 1156 bytes} [Wed Aug 3 12:59:21 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 12:59:21.696747 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-91f3f657-161c-42a1-af7c-0cef97b659c2 tempest-VolumesNegativeTest-1358784730 tempest-VolumesNegativeTest-1358784730-project] Calling method '.version_select at 0x7fe6da0a6c10>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:22.002023 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-91f3f657-161c-42a1-af7c-0cef97b659c2 tempest-VolumesNegativeTest-1358784730 tempest-VolumesNegativeTest-1358784730-project] HTTP exception thrown: Volume tempest-invalid-2100946479 could not be found. Aug 03 12:59:22.007344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-91f3f657-161c-42a1-af7c-0cef97b659c2 tempest-VolumesNegativeTest-1358784730 tempest-VolumesNegativeTest-1358784730-project] Request method failure captured: Aug 03 12:59:22.007344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2100946479 HTTP/1.1 Aug 03 12:59:22.007344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 12:59:22.007344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 12:59:22.007344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 12:59:22.007344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 0 Aug 03 12:59:22.007344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 12:59:22.007344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 12:59:22.007344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 12:59:22.007344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 12:59:22.007344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nEoucpxSQUvSiSmYBnQNGZ4rzfNQpqSk2nVHYS_k4gJuwwcUUaaR3RjVlve8H4_N2ZMXDirvQfc2hJBC2YOWDYCw3PXjaQhyn30ffh1_6AxlnNoOqdg8axSPxld9MxSAs23UyO_41dxTsrLalMlFIKLlaQprxr_xgR5ByoAFwIi1BA Aug 03 12:59:22.007344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 12:59:22.007344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 12:59:22.007344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 12:59:22.007344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 12:59:22.007344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 12:59:22.007344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 12:59:22.007344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: e20045ed345344aa827297413436e734 Aug 03 12:59:22.007344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-VolumesNegativeTest-1358784730 Aug 03 12:59:22.007344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 12:59:22.007344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 12:59:22.008680 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e20045ed345344aa827297413436e734"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e20045ed345344aa827297413436e734"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e20045ed345344aa827297413436e734"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e20045ed345344aa827297413436e734", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 12:59:22.008680 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-VolumesNegativeTest-1358784730 Aug 03 12:59:22.008680 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: e20045ed345344aa827297413436e734 Aug 03 12:59:22.008680 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-VolumesNegativeTest-1358784730 Aug 03 12:59:22.008680 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-VolumesNegativeTest-1358784730-project Aug 03 12:59:22.008680 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 12:59:22.008680 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 12:59:22.008680 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: cd605450595c446e887edf13518f542b Aug 03 12:59:22.008680 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-VolumesNegativeTest-1358784730-project Aug 03 12:59:22.008680 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: Aug 03 12:59:22.008680 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Volume tempest-invalid-2100946479 could not be found. Aug 03 12:59:22.008680 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'id': 'tempest-invalid-2100946479'} Aug 03 12:59:22.008680 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:59:22.009592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:59:22.009592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 12:59:22.009592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 12:59:22.009592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 12:59:22.009592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 12:59:22.009592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 12:59:22.009592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 12:59:22.009592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 12:59:22.009592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 12:59:22.009592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 12:59:22.009592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 12:59:22.009592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 12:59:22.009592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 12:59:22.009592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 12:59:22.009592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 12:59:22.009592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2100946479 could not be found. (HTTP 404) (Request-ID: req-7b36b975-80b7-4a16-85a8-aede5d735f13) Aug 03 12:59:22.009592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:22.009592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:59:22.009592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:22.010812 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:59:22.010812 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 03 12:59:22.010812 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 03 12:59:22.010812 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 12:59:22.010812 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 12:59:22.010812 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 12:59:22.010812 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 12:59:22.010812 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 12:59:22.010812 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 12:59:22.010812 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 12:59:22.010812 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 12:59:22.010812 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 12:59:22.010812 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 12:59:22.010812 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 12:59:22.010812 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 12:59:22.010812 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 12:59:22.010812 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 12:59:22.010812 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 12:59:22.010812 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 12:59:22.011904 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 12:59:22.011904 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 12:59:22.011904 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 12:59:22.011904 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 12:59:22.011904 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2100946479 could not be found. Aug 03 12:59:22.011904 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:22.011904 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:59:22.011904 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:22.011904 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:59:22.011904 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:59:22.011904 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:59:22.011904 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:59:22.011904 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:59:22.011904 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 12:59:22.011904 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 12:59:22.011904 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:59:22.011904 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:59:22.011904 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 03 12:59:22.011904 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:59:22.011904 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2100946479 could not be found. Aug 03 12:59:22.013048 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:22.013048 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:59:22.013048 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:22.013048 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:59:22.013048 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:59:22.013048 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:59:22.013048 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:59:22.013048 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:59:22.013048 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2100946479 could not be found. Aug 03 12:59:22.013048 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:22.015943 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-91f3f657-161c-42a1-af7c-0cef97b659c2 tempest-VolumesNegativeTest-1358784730 tempest-VolumesNegativeTest-1358784730-project] Returning 404 to user: Volume tempest-invalid-2100946479 could not be found. {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:59:22.020329 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-91f3f657-161c-42a1-af7c-0cef97b659c2 tempest-VolumesNegativeTest-1358784730 tempest-VolumesNegativeTest-1358784730-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2100946479" status: 404 len: 99 microversion: 2.1 time: 0.324851 Aug 03 12:59:22.022674 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 4/4] 10.222.0.64 () {58 vars in 1218 bytes} [Wed Aug 3 12:59:21 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2100946479 => generated 99 bytes in 331 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 12:59:22.041473 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-029674e6-d482-41ba-8c81-79073a3252b2 tempest-VolumesNegativeTest-1358784730 tempest-VolumesNegativeTest-1358784730-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010321 Aug 03 12:59:22.042561 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 5/5] 10.222.0.64 () {58 vars in 1140 bytes} [Wed Aug 3 12:59:22 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 03 12:59:22.057408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-16ffbdc4-7a63-4da5-b9ee-12e65e727f6e tempest-VolumesNegativeTest-1358784730 tempest-VolumesNegativeTest-1358784730-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003802 Aug 03 12:59:22.063649 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 6/6] 10.222.0.64 () {58 vars in 1137 bytes} [Wed Aug 3 12:59:22 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 03 12:59:22.076870 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-6b64382e-979c-4603-a1f0-d937a6f759f4 tempest-VolumesNegativeTest-1358784730 tempest-VolumesNegativeTest-1358784730-project] Calling method '.version_select at 0x7fe6d9fd8550>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:22.128815 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-6b64382e-979c-4603-a1f0-d937a6f759f4 tempest-VolumesNegativeTest-1358784730 tempest-VolumesNegativeTest-1358784730-project] HTTP exception thrown: Volume 356684b5-9f4f-4a6c-a9d6-55e4bdb7cb16 could not be found. Aug 03 12:59:22.133633 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-6b64382e-979c-4603-a1f0-d937a6f759f4 tempest-VolumesNegativeTest-1358784730 tempest-VolumesNegativeTest-1358784730-project] Request method failure captured: Aug 03 12:59:22.133633 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: DELETE /compute/v2.1/os-volumes/356684b5-9f4f-4a6c-a9d6-55e4bdb7cb16 HTTP/1.1 Aug 03 12:59:22.133633 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 12:59:22.133633 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 12:59:22.133633 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 12:59:22.133633 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 0 Aug 03 12:59:22.133633 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 12:59:22.133633 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 12:59:22.133633 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 12:59:22.133633 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 12:59:22.133633 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nEoucpxSQUvSiSmYBnQNGZ4rzfNQpqSk2nVHYS_k4gJuwwcUUaaR3RjVlve8H4_N2ZMXDirvQfc2hJBC2YOWDYCw3PXjaQhyn30ffh1_6AxlnNoOqdg8axSPxld9MxSAs23UyO_41dxTsrLalMlFIKLlaQprxr_xgR5ByoAFwIi1BA Aug 03 12:59:22.133633 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 12:59:22.133633 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 12:59:22.133633 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 12:59:22.133633 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 12:59:22.133633 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 12:59:22.133633 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 12:59:22.133633 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: e20045ed345344aa827297413436e734 Aug 03 12:59:22.133633 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-VolumesNegativeTest-1358784730 Aug 03 12:59:22.133633 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 12:59:22.133633 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 12:59:22.135142 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e20045ed345344aa827297413436e734"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e20045ed345344aa827297413436e734"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e20045ed345344aa827297413436e734"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e20045ed345344aa827297413436e734", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 12:59:22.135142 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-VolumesNegativeTest-1358784730 Aug 03 12:59:22.135142 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: e20045ed345344aa827297413436e734 Aug 03 12:59:22.135142 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-VolumesNegativeTest-1358784730 Aug 03 12:59:22.135142 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-VolumesNegativeTest-1358784730-project Aug 03 12:59:22.135142 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 12:59:22.135142 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 12:59:22.135142 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: cd605450595c446e887edf13518f542b Aug 03 12:59:22.135142 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-VolumesNegativeTest-1358784730-project Aug 03 12:59:22.135142 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: Aug 03 12:59:22.135142 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Volume 356684b5-9f4f-4a6c-a9d6-55e4bdb7cb16 could not be found. Aug 03 12:59:22.135142 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'id': '356684b5-9f4f-4a6c-a9d6-55e4bdb7cb16'} Aug 03 12:59:22.135142 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:59:22.136094 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:59:22.136094 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 12:59:22.136094 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 12:59:22.136094 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 12:59:22.136094 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 12:59:22.136094 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 12:59:22.136094 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 12:59:22.136094 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 12:59:22.136094 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 12:59:22.136094 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 12:59:22.136094 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 12:59:22.136094 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 12:59:22.136094 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 12:59:22.136094 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 12:59:22.136094 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 12:59:22.136094 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 356684b5-9f4f-4a6c-a9d6-55e4bdb7cb16 could not be found. (HTTP 404) (Request-ID: req-550c0f03-70d6-46bc-90b7-76feac23d491) Aug 03 12:59:22.136094 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:22.136094 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:59:22.136094 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:22.137408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:59:22.137408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 03 12:59:22.137408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 03 12:59:22.137408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 12:59:22.137408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 12:59:22.137408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 12:59:22.137408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 12:59:22.137408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 12:59:22.137408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 12:59:22.137408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 12:59:22.137408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 12:59:22.137408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 12:59:22.137408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 12:59:22.137408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 12:59:22.137408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 12:59:22.137408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 12:59:22.137408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 12:59:22.137408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 12:59:22.137408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 12:59:22.139683 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 12:59:22.139683 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 12:59:22.139683 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 12:59:22.139683 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 12:59:22.139683 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 356684b5-9f4f-4a6c-a9d6-55e4bdb7cb16 could not be found. Aug 03 12:59:22.139683 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:22.139683 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:59:22.139683 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:22.139683 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:59:22.139683 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:59:22.139683 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:59:22.139683 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:59:22.139683 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:59:22.139683 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 12:59:22.139683 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 12:59:22.139683 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:59:22.139683 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:59:22.139683 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 03 12:59:22.139683 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:59:22.142255 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 356684b5-9f4f-4a6c-a9d6-55e4bdb7cb16 could not be found. Aug 03 12:59:22.142255 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:22.142255 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:59:22.142255 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:22.142255 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:59:22.142255 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:59:22.142255 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:59:22.142255 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:59:22.142255 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:59:22.142255 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 356684b5-9f4f-4a6c-a9d6-55e4bdb7cb16 could not be found. Aug 03 12:59:22.142255 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:22.142255 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-6b64382e-979c-4603-a1f0-d937a6f759f4 tempest-VolumesNegativeTest-1358784730 tempest-VolumesNegativeTest-1358784730-project] Returning 404 to user: Volume 356684b5-9f4f-4a6c-a9d6-55e4bdb7cb16 could not be found. {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:59:22.142255 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-6b64382e-979c-4603-a1f0-d937a6f759f4 tempest-VolumesNegativeTest-1358784730 tempest-VolumesNegativeTest-1358784730-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/356684b5-9f4f-4a6c-a9d6-55e4bdb7cb16" status: 404 len: 109 microversion: 2.1 time: 0.074944 Aug 03 12:59:22.145507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 7/7] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Aug 3 12:59:22 2022] DELETE /compute/v2.1/os-volumes/356684b5-9f4f-4a6c-a9d6-55e4bdb7cb16 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:59:22.160681 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-1dc0ea16-9d7a-4a90-8638-394169b695c5 tempest-VolumesNegativeTest-1358784730 tempest-VolumesNegativeTest-1358784730-project] Calling method '.version_select at 0x7fe6d9fd83a0>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:22.176861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-66129d18-caea-4837-9fd5-bcb2eef2c0be tempest-VolumesGetTestJSON-1355229743 tempest-VolumesGetTestJSON-1355229743-project] Action: 'create', calling method: .version_select at 0x7fe6da1ea5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1286464568", "metadata": {"Type": "work"}}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:59:22.216648 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-1dc0ea16-9d7a-4a90-8638-394169b695c5 tempest-VolumesNegativeTest-1358784730 tempest-VolumesNegativeTest-1358784730-project] HTTP exception thrown: Volume 93408cf8-3c75-496c-ae6f-188d51c4dd2f could not be found. Aug 03 12:59:22.218792 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-1dc0ea16-9d7a-4a90-8638-394169b695c5 tempest-VolumesNegativeTest-1358784730 tempest-VolumesNegativeTest-1358784730-project] Request method failure captured: Aug 03 12:59:22.218792 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: GET /compute/v2.1/os-volumes/93408cf8-3c75-496c-ae6f-188d51c4dd2f HTTP/1.1 Aug 03 12:59:22.218792 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 12:59:22.218792 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 12:59:22.218792 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 12:59:22.218792 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 0 Aug 03 12:59:22.218792 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 12:59:22.218792 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 12:59:22.218792 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 12:59:22.218792 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 12:59:22.218792 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nEoucpxSQUvSiSmYBnQNGZ4rzfNQpqSk2nVHYS_k4gJuwwcUUaaR3RjVlve8H4_N2ZMXDirvQfc2hJBC2YOWDYCw3PXjaQhyn30ffh1_6AxlnNoOqdg8axSPxld9MxSAs23UyO_41dxTsrLalMlFIKLlaQprxr_xgR5ByoAFwIi1BA Aug 03 12:59:22.218792 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 12:59:22.218792 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 12:59:22.218792 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 12:59:22.218792 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 12:59:22.218792 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 12:59:22.218792 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 12:59:22.218792 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: e20045ed345344aa827297413436e734 Aug 03 12:59:22.218792 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-VolumesNegativeTest-1358784730 Aug 03 12:59:22.218792 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 12:59:22.218792 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 12:59:22.220247 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e20045ed345344aa827297413436e734"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e20045ed345344aa827297413436e734"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e20045ed345344aa827297413436e734"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e20045ed345344aa827297413436e734", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 12:59:22.220247 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-VolumesNegativeTest-1358784730 Aug 03 12:59:22.220247 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: e20045ed345344aa827297413436e734 Aug 03 12:59:22.220247 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-VolumesNegativeTest-1358784730 Aug 03 12:59:22.220247 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-VolumesNegativeTest-1358784730-project Aug 03 12:59:22.220247 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 12:59:22.220247 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 12:59:22.220247 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: cd605450595c446e887edf13518f542b Aug 03 12:59:22.220247 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-VolumesNegativeTest-1358784730-project Aug 03 12:59:22.220247 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: Aug 03 12:59:22.220247 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Volume 93408cf8-3c75-496c-ae6f-188d51c4dd2f could not be found. Aug 03 12:59:22.220247 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'id': '93408cf8-3c75-496c-ae6f-188d51c4dd2f'} Aug 03 12:59:22.220247 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:59:22.220997 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:59:22.220997 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 12:59:22.220997 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 12:59:22.220997 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 12:59:22.220997 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 12:59:22.220997 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 12:59:22.220997 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 12:59:22.220997 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 12:59:22.220997 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 12:59:22.220997 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 12:59:22.220997 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 12:59:22.220997 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 12:59:22.220997 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 12:59:22.220997 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 12:59:22.220997 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 12:59:22.220997 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 93408cf8-3c75-496c-ae6f-188d51c4dd2f could not be found. (HTTP 404) (Request-ID: req-a51efff5-2759-45b3-98c3-ff90c6066a09) Aug 03 12:59:22.220997 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:22.220997 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:59:22.220997 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:22.222108 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:59:22.222108 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 12:59:22.222108 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 12:59:22.222108 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 12:59:22.222108 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 12:59:22.222108 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 12:59:22.222108 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 12:59:22.222108 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 12:59:22.222108 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 12:59:22.222108 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 12:59:22.222108 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 12:59:22.222108 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 12:59:22.222108 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 12:59:22.222108 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 12:59:22.222108 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 12:59:22.222108 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 12:59:22.222108 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 12:59:22.222108 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 12:59:22.222108 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 12:59:22.223246 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 12:59:22.223246 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 12:59:22.223246 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 12:59:22.223246 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 12:59:22.223246 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 93408cf8-3c75-496c-ae6f-188d51c4dd2f could not be found. Aug 03 12:59:22.223246 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:22.223246 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:59:22.223246 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:22.223246 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:59:22.223246 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:59:22.223246 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:59:22.223246 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:59:22.223246 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:59:22.223246 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 12:59:22.223246 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 12:59:22.223246 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:59:22.223246 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:59:22.223246 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 12:59:22.223246 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:59:22.224419 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 93408cf8-3c75-496c-ae6f-188d51c4dd2f could not be found. Aug 03 12:59:22.224419 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:22.224419 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:59:22.224419 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:22.224419 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:59:22.224419 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:59:22.224419 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:59:22.224419 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:59:22.224419 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:59:22.224419 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 93408cf8-3c75-496c-ae6f-188d51c4dd2f could not be found. Aug 03 12:59:22.224419 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 12:59:22.227249 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-1dc0ea16-9d7a-4a90-8638-394169b695c5 tempest-VolumesNegativeTest-1358784730 tempest-VolumesNegativeTest-1358784730-project] Returning 404 to user: Volume 93408cf8-3c75-496c-ae6f-188d51c4dd2f could not be found. {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:59:22.227249 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-1dc0ea16-9d7a-4a90-8638-394169b695c5 tempest-VolumesNegativeTest-1358784730 tempest-VolumesNegativeTest-1358784730-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/93408cf8-3c75-496c-ae6f-188d51c4dd2f" status: 404 len: 109 microversion: 2.1 time: 0.080021 Aug 03 12:59:22.227249 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 8/8] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Aug 3 12:59:22 2022] GET /compute/v2.1/os-volumes/93408cf8-3c75-496c-ae6f-188d51c4dd2f => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:59:23.881789 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-66129d18-caea-4837-9fd5-bcb2eef2c0be tempest-VolumesGetTestJSON-1355229743 tempest-VolumesGetTestJSON-1355229743-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.955212 Aug 03 12:59:23.895570 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 1/9] 10.222.0.64 () {60 vars in 1156 bytes} [Wed Aug 3 12:59:20 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2970 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 03 12:59:23.899144 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-aced12d0-0b71-4ebc-8c7d-13867b7880e6 tempest-VolumesGetTestJSON-1355229743 tempest-VolumesGetTestJSON-1355229743-project] Calling method '.version_select at 0x7fe6da0a63a0>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:24.044870 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-aced12d0-0b71-4ebc-8c7d-13867b7880e6 tempest-VolumesGetTestJSON-1355229743 tempest-VolumesGetTestJSON-1355229743-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/e58cb9d7-98f9-4fa3-8d96-53de86719a19" status: 200 len: 353 microversion: 2.1 time: 0.151433 Aug 03 12:59:24.045708 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 9/10] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Aug 3 12:59:23 2022] GET /compute/v2.1/os-volumes/e58cb9d7-98f9-4fa3-8d96-53de86719a19 => generated 353 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:59:25.059554 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-62fa1ceb-63cb-4352-9668-83d1b3b74815 tempest-VolumesGetTestJSON-1355229743 tempest-VolumesGetTestJSON-1355229743-project] Calling method '.version_select at 0x7fe6da03d550>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:25.181239 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-62fa1ceb-63cb-4352-9668-83d1b3b74815 tempest-VolumesGetTestJSON-1355229743 tempest-VolumesGetTestJSON-1355229743-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/e58cb9d7-98f9-4fa3-8d96-53de86719a19" status: 200 len: 353 microversion: 2.1 time: 0.125978 Aug 03 12:59:25.181973 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 2/11] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Aug 3 12:59:25 2022] GET /compute/v2.1/os-volumes/e58cb9d7-98f9-4fa3-8d96-53de86719a19 => generated 353 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:59:25.382225 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-46474214-e129-489f-8e58-27e01483e828 tempest-VolumesTestJSON-856480960 tempest-VolumesTestJSON-856480960-project] Calling method '.version_select at 0x7fe6d9fd8c10>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:25.557437 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-46474214-e129-489f-8e58-27e01483e828 tempest-VolumesTestJSON-856480960 tempest-VolumesTestJSON-856480960-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/059c62a8-a86b-4c99-b332-6a0c4ce5b530" status: 200 len: 350 microversion: 2.1 time: 0.108898 Aug 03 12:59:25.557437 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 10/12] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Aug 3 12:59:25 2022] GET /compute/v2.1/os-volumes/059c62a8-a86b-4c99-b332-6a0c4ce5b530 => generated 350 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:59:26.194915 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1e260d3d-a80b-4c99-a2d5-5135fa78bcac tempest-VolumesGetTestJSON-1355229743 tempest-VolumesGetTestJSON-1355229743-project] Calling method '.version_select at 0x7fe6da03dc10>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:26.489910 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-1e260d3d-a80b-4c99-a2d5-5135fa78bcac tempest-VolumesGetTestJSON-1355229743 tempest-VolumesGetTestJSON-1355229743-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/e58cb9d7-98f9-4fa3-8d96-53de86719a19" status: 200 len: 354 microversion: 2.1 time: 0.298899 Aug 03 12:59:26.497877 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 3/13] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Aug 3 12:59:26 2022] GET /compute/v2.1/os-volumes/e58cb9d7-98f9-4fa3-8d96-53de86719a19 => generated 354 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:59:26.508820 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d5f4f760-fc7b-47ae-b78f-93ee038ecfed tempest-VolumesGetTestJSON-1355229743 tempest-VolumesGetTestJSON-1355229743-project] Calling method '.version_select at 0x7fe6d9fd8310>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:26.714213 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-d5f4f760-fc7b-47ae-b78f-93ee038ecfed tempest-VolumesGetTestJSON-1355229743 tempest-VolumesGetTestJSON-1355229743-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/e58cb9d7-98f9-4fa3-8d96-53de86719a19" status: 200 len: 354 microversion: 2.1 time: 0.214314 Aug 03 12:59:26.729842 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 11/14] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Aug 3 12:59:26 2022] GET /compute/v2.1/os-volumes/e58cb9d7-98f9-4fa3-8d96-53de86719a19 => generated 354 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:59:26.745019 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1c5b0bfa-ddb7-4536-b1dc-b1ea27591d59 tempest-VolumesGetTestJSON-1355229743 tempest-VolumesGetTestJSON-1355229743-project] Calling method '.version_select at 0x7fe6da054310>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:27.430564 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-1c5b0bfa-ddb7-4536-b1dc-b1ea27591d59 tempest-VolumesGetTestJSON-1355229743 tempest-VolumesGetTestJSON-1355229743-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/e58cb9d7-98f9-4fa3-8d96-53de86719a19" status: 202 len: 0 microversion: 2.1 time: 0.690406 Aug 03 12:59:27.430564 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 4/15] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Aug 3 12:59:26 2022] DELETE /compute/v2.1/os-volumes/e58cb9d7-98f9-4fa3-8d96-53de86719a19 => generated 0 bytes in 693 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 12:59:27.436754 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-fa814cc2-c2ad-43b6-b330-f55857bebe2c tempest-VolumesGetTestJSON-1355229743 tempest-VolumesGetTestJSON-1355229743-project] Calling method '.version_select at 0x7fe6d9fe2160>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:27.503915 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-fa814cc2-c2ad-43b6-b330-f55857bebe2c tempest-VolumesGetTestJSON-1355229743 tempest-VolumesGetTestJSON-1355229743-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/e58cb9d7-98f9-4fa3-8d96-53de86719a19" status: 200 len: 353 microversion: 2.1 time: 0.071746 Aug 03 12:59:27.508680 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 12/16] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Aug 3 12:59:27 2022] GET /compute/v2.1/os-volumes/e58cb9d7-98f9-4fa3-8d96-53de86719a19 => generated 353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:59:28.525876 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-43ede20d-8983-401d-b79e-d751a30daf1e tempest-VolumesGetTestJSON-1355229743 tempest-VolumesGetTestJSON-1355229743-project] Calling method '.version_select at 0x7fe6da03ddc0>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:28.616474 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.wsgi [None req-43ede20d-8983-401d-b79e-d751a30daf1e tempest-VolumesGetTestJSON-1355229743 tempest-VolumesGetTestJSON-1355229743-project] HTTP exception thrown: Volume e58cb9d7-98f9-4fa3-8d96-53de86719a19 could not be found. Aug 03 12:59:28.630122 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-43ede20d-8983-401d-b79e-d751a30daf1e tempest-VolumesGetTestJSON-1355229743 tempest-VolumesGetTestJSON-1355229743-project] Request method failure captured: Aug 03 12:59:28.630122 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: request: GET /compute/v2.1/os-volumes/e58cb9d7-98f9-4fa3-8d96-53de86719a19 HTTP/1.1 Aug 03 12:59:28.630122 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept: application/json Aug 03 12:59:28.630122 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept-Encoding: identity Aug 03 12:59:28.630122 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Connection: close Aug 03 12:59:28.630122 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Length: 0 Aug 03 12:59:28.630122 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Type: application/json Aug 03 12:59:28.630122 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Host: 10.222.0.64 Aug 03 12:59:28.630122 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Openstack-System-Scope: None Aug 03 12:59:28.630122 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: User-Agent: python-urllib3/1.26.10 Aug 03 12:59:28.630122 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Auth-Token: gAAAAABi6nEoRn4nBRKkjYzYYPfySV0T7swdt-zkesavLSGWRg5BVF13E-vj1CvSloXkOspyhv9rp1NbeRtI18bVxfE-I5RCovee8qbD7rPH2UB_UMooPCrUi64Ek5-fmfJDhq8GOcGCGZVdPX3PhvZ8M9BfiU1xlEZnRhOtDTP1L-mIxqvtwI8 Aug 03 12:59:28.630122 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Id: None Aug 03 12:59:28.630122 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Name: None Aug 03 12:59:28.630122 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Identity-Status: Confirmed Aug 03 12:59:28.630122 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Is-Admin-Project: True Aug 03 12:59:28.630122 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Id: default Aug 03 12:59:28.630122 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Name: Default Aug 03 12:59:28.630122 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Id: 755dcaa4b12d47a18a0603b7fa44a8c3 Aug 03 12:59:28.630122 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Name: tempest-VolumesGetTestJSON-1355229743 Aug 03 12:59:28.630122 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Role: member,reader Aug 03 12:59:28.630122 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Roles: member,reader Aug 03 12:59:28.631645 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/755dcaa4b12d47a18a0603b7fa44a8c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/755dcaa4b12d47a18a0603b7fa44a8c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/755dcaa4b12d47a18a0603b7fa44a8c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_755dcaa4b12d47a18a0603b7fa44a8c3", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 12:59:28.631645 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant: tempest-VolumesGetTestJSON-1355229743 Aug 03 12:59:28.631645 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Id: 755dcaa4b12d47a18a0603b7fa44a8c3 Aug 03 12:59:28.631645 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Name: tempest-VolumesGetTestJSON-1355229743 Aug 03 12:59:28.631645 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User: tempest-VolumesGetTestJSON-1355229743-project Aug 03 12:59:28.631645 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Id: default Aug 03 12:59:28.631645 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Name: Default Aug 03 12:59:28.631645 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Id: bc9f481cb12e4575b31b2f192fa881ba Aug 03 12:59:28.631645 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Name: tempest-VolumesGetTestJSON-1355229743-project Aug 03 12:59:28.631645 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: method: Aug 03 12:59:28.631645 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: exception: Volume e58cb9d7-98f9-4fa3-8d96-53de86719a19 could not be found. Aug 03 12:59:28.631645 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: action_args: {'id': 'e58cb9d7-98f9-4fa3-8d96-53de86719a19'} Aug 03 12:59:28.631645 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:59:28.632485 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:59:28.632485 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 12:59:28.632485 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 12:59:28.632485 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 12:59:28.632485 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 12:59:28.632485 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 12:59:28.632485 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 12:59:28.632485 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 12:59:28.632485 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 12:59:28.632485 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 12:59:28.632485 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 12:59:28.632485 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 12:59:28.632485 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 12:59:28.632485 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 12:59:28.632485 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 12:59:28.632485 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e58cb9d7-98f9-4fa3-8d96-53de86719a19 could not be found. (HTTP 404) (Request-ID: req-0741ca75-4191-49e4-b81e-a5317c2e7742) Aug 03 12:59:28.632485 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 12:59:28.632485 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:59:28.632485 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 12:59:28.633661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:59:28.633661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 12:59:28.633661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 12:59:28.633661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 12:59:28.633661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 12:59:28.633661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 12:59:28.633661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 12:59:28.633661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 12:59:28.633661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 12:59:28.633661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 12:59:28.633661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 12:59:28.633661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 12:59:28.633661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 12:59:28.633661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 12:59:28.633661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 12:59:28.633661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 12:59:28.633661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 12:59:28.633661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 12:59:28.633661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 12:59:28.634778 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 12:59:28.634778 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 12:59:28.634778 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 12:59:28.634778 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 12:59:28.634778 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e58cb9d7-98f9-4fa3-8d96-53de86719a19 could not be found. Aug 03 12:59:28.634778 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 12:59:28.634778 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:59:28.634778 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 12:59:28.634778 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:59:28.634778 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:59:28.634778 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:59:28.634778 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:59:28.634778 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:59:28.634778 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 12:59:28.634778 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 12:59:28.634778 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:59:28.634778 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:59:28.634778 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 12:59:28.634778 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:59:28.635897 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e58cb9d7-98f9-4fa3-8d96-53de86719a19 could not be found. Aug 03 12:59:28.635897 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 12:59:28.635897 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:59:28.635897 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 12:59:28.635897 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:59:28.635897 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:59:28.635897 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:59:28.635897 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:59:28.635897 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:59:28.635897 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e58cb9d7-98f9-4fa3-8d96-53de86719a19 could not be found. Aug 03 12:59:28.635897 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 12:59:28.637867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-43ede20d-8983-401d-b79e-d751a30daf1e tempest-VolumesGetTestJSON-1355229743 tempest-VolumesGetTestJSON-1355229743-project] Returning 404 to user: Volume e58cb9d7-98f9-4fa3-8d96-53de86719a19 could not be found. {{(pid=119410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:59:28.641079 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-43ede20d-8983-401d-b79e-d751a30daf1e tempest-VolumesGetTestJSON-1355229743 tempest-VolumesGetTestJSON-1355229743-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/e58cb9d7-98f9-4fa3-8d96-53de86719a19" status: 404 len: 109 microversion: 2.1 time: 0.121384 Aug 03 12:59:28.642226 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 5/17] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Aug 3 12:59:28 2022] GET /compute/v2.1/os-volumes/e58cb9d7-98f9-4fa3-8d96-53de86719a19 => generated 109 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:59:29.095389 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-6aa93f01-38ae-472a-b525-81490defd291 tempest-VolumesTestJSON-856480960 tempest-VolumesTestJSON-856480960-project] Calling method '.version_select at 0x7fe6d9fd8790>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:29.202090 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-6aa93f01-38ae-472a-b525-81490defd291 tempest-VolumesTestJSON-856480960 tempest-VolumesTestJSON-856480960-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/edffec6e-2083-4cd5-9090-a2965efec1b8" status: 200 len: 351 microversion: 2.1 time: 0.110914 Aug 03 12:59:29.209879 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 13/18] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Aug 3 12:59:29 2022] GET /compute/v2.1/os-volumes/edffec6e-2083-4cd5-9090-a2965efec1b8 => generated 351 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:59:31.303045 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-9aa5f307-3c6b-4138-ae04-89551808196f tempest-VolumesTestJSON-856480960 tempest-VolumesTestJSON-856480960-project] Calling method '.version_select at 0x7fe6daa15b80>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:31.407798 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-9aa5f307-3c6b-4138-ae04-89551808196f tempest-VolumesTestJSON-856480960 tempest-VolumesTestJSON-856480960-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/a5024cd1-3b62-448b-b49c-afc57c1a8824" status: 200 len: 351 microversion: 2.1 time: 0.109850 Aug 03 12:59:31.418101 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 6/19] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Aug 3 12:59:31 2022] GET /compute/v2.1/os-volumes/a5024cd1-3b62-448b-b49c-afc57c1a8824 => generated 351 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:59:31.426819 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-9827dd22-aa42-4ea5-afd0-67126193fc18 tempest-VolumesTestJSON-856480960 tempest-VolumesTestJSON-856480960-project] Calling method '.version_select at 0x7fe6da054ee0>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:31.604744 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-9827dd22-aa42-4ea5-afd0-67126193fc18 tempest-VolumesTestJSON-856480960 tempest-VolumesTestJSON-856480960-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.173532 Aug 03 12:59:31.605751 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 7/20] 10.222.0.64 () {58 vars in 1134 bytes} [Wed Aug 3 12:59:31 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:59:31.611711 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-79f258dc-ab25-4f49-856e-5441e5359a7d tempest-VolumesTestJSON-856480960 tempest-VolumesTestJSON-856480960-project] Calling method '.version_select at 0x7fe6da051d30>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:31.865874 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-79f258dc-ab25-4f49-856e-5441e5359a7d tempest-VolumesTestJSON-856480960 tempest-VolumesTestJSON-856480960-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.258567 Aug 03 12:59:31.866461 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 8/21] 10.222.0.64 () {58 vars in 1149 bytes} [Wed Aug 3 12:59:31 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:59:31.884456 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-b2f7c13a-610a-4cb4-a084-2b124c3a3cc8 tempest-VolumesTestJSON-856480960 tempest-VolumesTestJSON-856480960-project] Calling method '.version_select at 0x7fe6da055f70>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:32.152404 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-b2f7c13a-610a-4cb4-a084-2b124c3a3cc8 tempest-VolumesTestJSON-856480960 tempest-VolumesTestJSON-856480960-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.274466 Aug 03 12:59:32.153312 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 9/22] 10.222.0.64 () {58 vars in 1134 bytes} [Wed Aug 3 12:59:31 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:59:32.175375 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-2a000b25-1539-4743-8c5f-3935f22bb044 tempest-VolumesTestJSON-856480960 tempest-VolumesTestJSON-856480960-project] Calling method '.version_select at 0x7fe6da051dc0>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:32.276109 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d84b7e02-6fda-4fae-aef7-38853692b0d4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1575335658", "imageRef": "c0aabcc0-d4af-4f0e-b8a5-d140344fce1f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:59:32.370522 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-2a000b25-1539-4743-8c5f-3935f22bb044 tempest-VolumesTestJSON-856480960 tempest-VolumesTestJSON-856480960-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.198628 Aug 03 12:59:32.370522 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 10/23] 10.222.0.64 () {58 vars in 1167 bytes} [Wed Aug 3 12:59:32 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:59:32.375673 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-9074d584-e58f-450b-a865-f53cca17a45d tempest-VolumesTestJSON-856480960 tempest-VolumesTestJSON-856480960-project] Calling method '.version_select at 0x7fe6da054ee0>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:32.551641 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.network.neutron [None req-d84b7e02-6fda-4fae-aef7-38853692b0d4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] validate_networks() for [('ffaaaafc-a452-4bff-877a-5ebe89d49029', None, None, None, None, None)] {{(pid=119409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 12:59:32.590145 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-9074d584-e58f-450b-a865-f53cca17a45d tempest-VolumesTestJSON-856480960 tempest-VolumesTestJSON-856480960-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.217694 Aug 03 12:59:32.593796 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 11/24] 10.222.0.64 () {58 vars in 1170 bytes} [Wed Aug 3 12:59:32 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:59:32.610801 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-ada8b8f2-a104-4fa6-a8fb-adce29e2705e tempest-VolumesTestJSON-856480960 tempest-VolumesTestJSON-856480960-project] Calling method '.version_select at 0x7fe6d9fb8790>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:32.718869 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-ada8b8f2-a104-4fa6-a8fb-adce29e2705e tempest-VolumesTestJSON-856480960 tempest-VolumesTestJSON-856480960-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.116369 Aug 03 12:59:32.719782 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 12/25] 10.222.0.64 () {58 vars in 1155 bytes} [Wed Aug 3 12:59:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:59:32.733276 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-259c7254-e91e-4004-abcc-2ccc0e6667c8 tempest-VolumesTestJSON-856480960 tempest-VolumesTestJSON-856480960-project] Calling method '.version_select at 0x7fe6da054dc0>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:32.877049 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-259c7254-e91e-4004-abcc-2ccc0e6667c8 tempest-VolumesTestJSON-856480960 tempest-VolumesTestJSON-856480960-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.148424 Aug 03 12:59:32.880745 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 13/26] 10.222.0.64 () {58 vars in 1188 bytes} [Wed Aug 3 12:59:32 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:59:32.892843 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-fdabbe6f-ebb9-4efa-a6e6-f681d0c9414f tempest-VolumesTestJSON-856480960 tempest-VolumesTestJSON-856480960-project] Calling method '.version_select at 0x7fe6da051ca0>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:33.079204 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-fdabbe6f-ebb9-4efa-a6e6-f681d0c9414f tempest-VolumesTestJSON-856480960 tempest-VolumesTestJSON-856480960-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.190243 Aug 03 12:59:33.080032 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 14/27] 10.222.0.64 () {58 vars in 1155 bytes} [Wed Aug 3 12:59:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:59:36.882028 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-9c3acfc9-974e-412b-9251-0df18b8f6687 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1579557136", "imageRef": "c0aabcc0-d4af-4f0e-b8a5-d140344fce1f", "flavorRef": "452", "networks": [{"uuid": "c11c8659-da2f-4788-a37e-830e07880054"}]}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:59:36.982664 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-d84b7e02-6fda-4fae-aef7-38853692b0d4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Flavor limits 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 12:59:36.983195 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-d84b7e02-6fda-4fae-aef7-38853692b0d4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Image limits 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 12:59:36.983651 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-d84b7e02-6fda-4fae-aef7-38853692b0d4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Flavor pref 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 12:59:36.985110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-d84b7e02-6fda-4fae-aef7-38853692b0d4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Image pref 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 12:59:36.985638 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-d84b7e02-6fda-4fae-aef7-38853692b0d4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 12:59:37.051858 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d84b7e02-6fda-4fae-aef7-38853692b0d4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:37.052713 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d84b7e02-6fda-4fae-aef7-38853692b0d4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:37.053868 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d84b7e02-6fda-4fae-aef7-38853692b0d4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:37.056557 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d84b7e02-6fda-4fae-aef7-38853692b0d4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:37.132789 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-d84b7e02-6fda-4fae-aef7-38853692b0d4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Getting quotas for project 6be1056fe005471f83a0633c99c0b349. Resources: {'instances', 'ram', 'cores'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:59:37.160549 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.network.neutron [None req-9c3acfc9-974e-412b-9251-0df18b8f6687 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] validate_networks() for [('c11c8659-da2f-4788-a37e-830e07880054', None, None, None, None, None)] {{(pid=119410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 12:59:37.185956 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-d84b7e02-6fda-4fae-aef7-38853692b0d4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Getting quotas for user bb5f78a0ee0642c7bbde2ecf34e090d0 and project 6be1056fe005471f83a0633c99c0b349. Resources: {'instances', 'ram', 'cores'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:59:37.226562 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-d84b7e02-6fda-4fae-aef7-38853692b0d4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Going to run 1 instances... {{(pid=119409) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 12:59:37.231193 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-d84b7e02-6fda-4fae-aef7-38853692b0d4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0aabcc0-d4af-4f0e-b8a5-d140344fce1f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 12:59:37.444854 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-d84b7e02-6fda-4fae-aef7-38853692b0d4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.065683 Aug 03 12:59:37.445871 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 14/28] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 3 12:59:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 6067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 12:59:37.461099 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-2b981eb4-fe5b-4e51-9a54-2796f61889ef tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:37.461744 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-2b981eb4-fe5b-4e51-9a54-2796f61889ef tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:37.776321 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-2b981eb4-fe5b-4e51-9a54-2796f61889ef tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:37.807127 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-2b981eb4-fe5b-4e51-9a54-2796f61889ef tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1222 microversion: 2.1 time: 0.352318 Aug 03 12:59:37.818843 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 15/29] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 12:59:37 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1222 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:59:38.276228 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-c7c191f1-52f9-4bb5-9b51-c9f52d6c0e6a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1246938923", "imageRef": "c0aabcc0-d4af-4f0e-b8a5-d140344fce1f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:59:38.434344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.network.neutron [None req-c7c191f1-52f9-4bb5-9b51-c9f52d6c0e6a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] validate_networks() for [('ffaaaafc-a452-4bff-877a-5ebe89d49029', None, None, None, None, None)] {{(pid=119409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 12:59:39.551536 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-c7c191f1-52f9-4bb5-9b51-c9f52d6c0e6a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Flavor limits 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 12:59:39.554545 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-c7c191f1-52f9-4bb5-9b51-c9f52d6c0e6a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Image limits 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 12:59:39.555328 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-c7c191f1-52f9-4bb5-9b51-c9f52d6c0e6a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Flavor pref 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 12:59:39.555919 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-c7c191f1-52f9-4bb5-9b51-c9f52d6c0e6a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Image pref 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 12:59:39.556558 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-c7c191f1-52f9-4bb5-9b51-c9f52d6c0e6a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 12:59:39.572812 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c7c191f1-52f9-4bb5-9b51-c9f52d6c0e6a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:39.576621 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c7c191f1-52f9-4bb5-9b51-c9f52d6c0e6a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:39.580467 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c7c191f1-52f9-4bb5-9b51-c9f52d6c0e6a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:39.580467 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c7c191f1-52f9-4bb5-9b51-c9f52d6c0e6a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:39.647294 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-c7c191f1-52f9-4bb5-9b51-c9f52d6c0e6a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Getting quotas for project 6be1056fe005471f83a0633c99c0b349. Resources: {'instances', 'ram', 'cores'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:59:39.665573 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-c7c191f1-52f9-4bb5-9b51-c9f52d6c0e6a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Getting quotas for user bb5f78a0ee0642c7bbde2ecf34e090d0 and project 6be1056fe005471f83a0633c99c0b349. Resources: {'instances', 'ram', 'cores'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:59:39.707471 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-c7c191f1-52f9-4bb5-9b51-c9f52d6c0e6a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Going to run 1 instances... {{(pid=119409) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 12:59:39.713302 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-c7c191f1-52f9-4bb5-9b51-c9f52d6c0e6a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0aabcc0-d4af-4f0e-b8a5-d140344fce1f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 12:59:39.871091 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-c7c191f1-52f9-4bb5-9b51-c9f52d6c0e6a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.602503 Aug 03 12:59:39.878691 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 16/30] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 3 12:59:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 1611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 12:59:40.363191 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-72013ffa-5a8a-4704-ba02-94efafc484b5 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Action: 'create', calling method: .version_select at 0x7fe6d8e8f940>, body: {"keypair": {"name": "tempest-keypair-1389109726", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNL601tIWWv9tNC7DmyHAvbSXbIWwhj0oYwh0QzTqJn2iO/RdwYEXcqNQe/jA/x3URHqhdPvNSI1XXkudnAC61mdkE2P1Lk5fBodKnFjB+/EdOcjzm46S4I+aDno9wSP+g=="}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:59:40.412760 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-72013ffa-5a8a-4704-ba02-94efafc484b5 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Getting quotas for project 3a420d95334148b68d78a6497e0d95f5. Resources: {'key_pairs'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:59:40.418476 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-72013ffa-5a8a-4704-ba02-94efafc484b5 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Getting quotas for user 6ec4b53cb3a64c3aa9cb6a186a61c1fe and project 3a420d95334148b68d78a6497e0d95f5. Resources: {'key_pairs'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:59:40.515607 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-9c3acfc9-974e-412b-9251-0df18b8f6687 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Flavor limits 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 12:59:40.516098 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-9c3acfc9-974e-412b-9251-0df18b8f6687 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Image limits 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 12:59:40.516555 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-9c3acfc9-974e-412b-9251-0df18b8f6687 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Flavor pref 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 12:59:40.517036 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-9c3acfc9-974e-412b-9251-0df18b8f6687 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Image pref 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 12:59:40.517826 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-9c3acfc9-974e-412b-9251-0df18b8f6687 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 12:59:40.555817 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-72013ffa-5a8a-4704-ba02-94efafc484b5 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.675928 Aug 03 12:59:40.557597 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 17/31] 10.222.0.64 () {62 vars in 1200 bytes} [Wed Aug 3 12:59:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 678 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 03 12:59:40.590657 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-40f41a9c-4db3-4583-9297-c05ad8937930 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:40.600119 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-40f41a9c-4db3-4583-9297-c05ad8937930 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:40.612663 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9c3acfc9-974e-412b-9251-0df18b8f6687 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:40.613131 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9c3acfc9-974e-412b-9251-0df18b8f6687 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:40.613941 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9c3acfc9-974e-412b-9251-0df18b8f6687 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:40.614540 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9c3acfc9-974e-412b-9251-0df18b8f6687 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:40.756828 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.quota [None req-9c3acfc9-974e-412b-9251-0df18b8f6687 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Getting quotas for project b4c4a2f8c7864ee692c5b1b55b4aacac. Resources: {'instances', 'ram', 'cores'} {{(pid=119410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:59:40.767607 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.quota [None req-9c3acfc9-974e-412b-9251-0df18b8f6687 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Getting quotas for user bbf46bef60464329afdf2df75842a41e and project b4c4a2f8c7864ee692c5b1b55b4aacac. Resources: {'instances', 'ram', 'cores'} {{(pid=119410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:59:40.783913 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-9c3acfc9-974e-412b-9251-0df18b8f6687 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Going to run 1 instances... {{(pid=119410) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 12:59:40.788053 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-9c3acfc9-974e-412b-9251-0df18b8f6687 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0aabcc0-d4af-4f0e-b8a5-d140344fce1f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 12:59:40.939801 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-40f41a9c-4db3-4583-9297-c05ad8937930 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:40.947676 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-40f41a9c-4db3-4583-9297-c05ad8937930 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1222 microversion: 2.1 time: 0.386382 Aug 03 12:59:40.967158 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 18/32] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 12:59:40 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1222 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:59:41.034902 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-9c3acfc9-974e-412b-9251-0df18b8f6687 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.804293 Aug 03 12:59:41.035623 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 15/33] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 3 12:59:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 4806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 12:59:41.050084 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-4db5e318-e876-4a4c-afe7-bee87f4d66f6 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:41.050710 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-4db5e318-e876-4a4c-afe7-bee87f4d66f6 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:41.276853 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-4db5e318-e876-4a4c-afe7-bee87f4d66f6 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:41.310192 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-4db5e318-e876-4a4c-afe7-bee87f4d66f6 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1215 microversion: 2.1 time: 0.263099 Aug 03 12:59:41.312591 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 16/34] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 12:59:41 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1215 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:59:41.512629 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-95521869-71ca-449d-abb6-d953df1dd040 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Action: 'create', calling method: .version_select at 0x7fe6d8ea95e0>, body: {"keypair": {"name": "tempest-keypair-488394907", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5pvPin9NsHXt/l90Ub3xWdOw+amw50E2adxYpo7Mkp+pf5G7popiCEcTC/bMctSwVW8F3uxd5I7kh3sQXPSx9YlBhxHqZkUUtwqKoeQwqhiHj4n3PlIJ2xCaYzfm6+Fw=="}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:59:41.557974 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-95521869-71ca-449d-abb6-d953df1dd040 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Getting quotas for project 23cfcb8de5e448b8af185376a035263b. Resources: {'key_pairs'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:59:41.580128 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-95521869-71ca-449d-abb6-d953df1dd040 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Getting quotas for user 36693fa42a7b41279c8d8c59ecafb243 and project 23cfcb8de5e448b8af185376a035263b. Resources: {'key_pairs'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:59:41.778688 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-95521869-71ca-449d-abb6-d953df1dd040 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.810177 Aug 03 12:59:41.782006 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 19/35] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Aug 3 12:59:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:59:41.989346 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-4cd7fc91-25c6-419d-9fac-99b13dfa1f42 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:41.990041 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-4cd7fc91-25c6-419d-9fac-99b13dfa1f42 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:42.149799 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-4cd7fc91-25c6-419d-9fac-99b13dfa1f42 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:42.163116 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-4cd7fc91-25c6-419d-9fac-99b13dfa1f42 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1222 microversion: 2.1 time: 0.176008 Aug 03 12:59:42.164544 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 17/36] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 12:59:41 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1222 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:59:42.356555 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-26596f68-551b-455e-94d2-8305310f76fe tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:42.365556 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-26596f68-551b-455e-94d2-8305310f76fe tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:42.747894 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-26596f68-551b-455e-94d2-8305310f76fe tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:42.765400 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-26596f68-551b-455e-94d2-8305310f76fe tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1215 microversion: 2.1 time: 0.435031 Aug 03 12:59:42.766860 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 20/37] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 12:59:42 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1215 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:59:43.184251 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-0f72970d-7d32-455a-a5a3-7a862311168d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:43.185519 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-0f72970d-7d32-455a-a5a3-7a862311168d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:43.195294 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0f72970d-7d32-455a-a5a3-7a862311168d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:43.195754 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0f72970d-7d32-455a-a5a3-7a862311168d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:43.196537 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0f72970d-7d32-455a-a5a3-7a862311168d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:43.202228 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0f72970d-7d32-455a-a5a3-7a862311168d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:43.638666 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-0f72970d-7d32-455a-a5a3-7a862311168d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:43.656607 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-0f72970d-7d32-455a-a5a3-7a862311168d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1218 microversion: 2.1 time: 0.476035 Aug 03 12:59:43.674817 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 18/38] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 12:59:43 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1218 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:59:43.791854 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-f7e1636b-e27b-4401-bc6d-56db288c7f99 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:43.793197 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-f7e1636b-e27b-4401-bc6d-56db288c7f99 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:43.800081 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f7e1636b-e27b-4401-bc6d-56db288c7f99 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:43.801436 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f7e1636b-e27b-4401-bc6d-56db288c7f99 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:43.802228 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f7e1636b-e27b-4401-bc6d-56db288c7f99 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:43.802671 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f7e1636b-e27b-4401-bc6d-56db288c7f99 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:44.102292 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-f7e1636b-e27b-4401-bc6d-56db288c7f99 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:44.117355 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-f7e1636b-e27b-4401-bc6d-56db288c7f99 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1211 microversion: 2.1 time: 0.329553 Aug 03 12:59:44.118320 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 21/39] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 12:59:43 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1211 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:59:44.696501 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-22f9dfae-0b1b-4634-87f5-f6ca3b724a08 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:44.697162 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-22f9dfae-0b1b-4634-87f5-f6ca3b724a08 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:44.709740 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-22f9dfae-0b1b-4634-87f5-f6ca3b724a08 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:44.710194 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-22f9dfae-0b1b-4634-87f5-f6ca3b724a08 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:44.716450 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-22f9dfae-0b1b-4634-87f5-f6ca3b724a08 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:44.716834 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-22f9dfae-0b1b-4634-87f5-f6ca3b724a08 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:44.909682 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-22f9dfae-0b1b-4634-87f5-f6ca3b724a08 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:44.918768 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-22f9dfae-0b1b-4634-87f5-f6ca3b724a08 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1282 microversion: 2.1 time: 0.226367 Aug 03 12:59:44.919795 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 19/40] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 12:59:44 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1282 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:59:45.162362 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-b101c0b0-4984-4d32-b8d6-12bdf98ed730 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:45.166320 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-b101c0b0-4984-4d32-b8d6-12bdf98ed730 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:45.179648 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b101c0b0-4984-4d32-b8d6-12bdf98ed730 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:45.181847 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b101c0b0-4984-4d32-b8d6-12bdf98ed730 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:45.183107 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b101c0b0-4984-4d32-b8d6-12bdf98ed730 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:45.183766 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b101c0b0-4984-4d32-b8d6-12bdf98ed730 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:45.403449 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b101c0b0-4984-4d32-b8d6-12bdf98ed730 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:45.415381 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-b101c0b0-4984-4d32-b8d6-12bdf98ed730 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1267 microversion: 2.1 time: 0.279086 Aug 03 12:59:45.431499 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 22/41] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 12:59:45 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1267 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:59:45.942820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-48bd5f6b-4e57-4950-b8e7-e158c8a56bf6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:45.944095 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-48bd5f6b-4e57-4950-b8e7-e158c8a56bf6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:45.958646 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-48bd5f6b-4e57-4950-b8e7-e158c8a56bf6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:45.960041 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-48bd5f6b-4e57-4950-b8e7-e158c8a56bf6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:45.964282 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-48bd5f6b-4e57-4950-b8e7-e158c8a56bf6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:45.964999 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-48bd5f6b-4e57-4950-b8e7-e158c8a56bf6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:46.222017 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-48bd5f6b-4e57-4950-b8e7-e158c8a56bf6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:46.232536 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-48bd5f6b-4e57-4950-b8e7-e158c8a56bf6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1280 microversion: 2.1 time: 0.295595 Aug 03 12:59:46.235767 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 20/42] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 12:59:45 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1280 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:59:46.450608 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-319bf1f3-ebef-4cb3-ae0e-6252af5d4028 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:46.452070 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-319bf1f3-ebef-4cb3-ae0e-6252af5d4028 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:46.476502 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-319bf1f3-ebef-4cb3-ae0e-6252af5d4028 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:46.477706 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-319bf1f3-ebef-4cb3-ae0e-6252af5d4028 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:46.481937 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-319bf1f3-ebef-4cb3-ae0e-6252af5d4028 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:46.483320 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-319bf1f3-ebef-4cb3-ae0e-6252af5d4028 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:46.728316 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-319bf1f3-ebef-4cb3-ae0e-6252af5d4028 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:46.737793 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-319bf1f3-ebef-4cb3-ae0e-6252af5d4028 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1273 microversion: 2.1 time: 0.301360 Aug 03 12:59:46.759876 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 23/43] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 12:59:46 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1273 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:59:47.259521 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-7b218105-fdf6-4173-8ca6-f883f0012ffc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:47.261085 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-7b218105-fdf6-4173-8ca6-f883f0012ffc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:47.274170 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7b218105-fdf6-4173-8ca6-f883f0012ffc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:47.274665 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7b218105-fdf6-4173-8ca6-f883f0012ffc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:47.281083 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7b218105-fdf6-4173-8ca6-f883f0012ffc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:47.281538 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7b218105-fdf6-4173-8ca6-f883f0012ffc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:47.588428 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-00524080-fe3a-48b9-8024-4e510d77689f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-232262529", "imageRef": "c0aabcc0-d4af-4f0e-b8a5-d140344fce1f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "478554d7-f7a0-4b58-8d9d-6206d50b7fb1"}], "security_groups": [{"name": "tempest-securitygroup--1431640301"}], "key_name": "tempest-keypair-1389109726", "user_data": "}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:59:48.972286 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.network.neutron [None req-00524080-fe3a-48b9-8024-4e510d77689f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] validate_networks() for [('478554d7-f7a0-4b58-8d9d-6206d50b7fb1', None, None, None, None, None)] {{(pid=119409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 12:59:49.394166 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-7b218105-fdf6-4173-8ca6-f883f0012ffc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:49.403287 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-7b218105-fdf6-4173-8ca6-f883f0012ffc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1322 microversion: 2.1 time: 2.150176 Aug 03 12:59:49.414271 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 21/44] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 12:59:47 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1322 bytes in 2162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:59:49.433742 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d1011d86-b173-4a92-ad8f-a21e0a28b536 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:49.435086 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d1011d86-b173-4a92-ad8f-a21e0a28b536 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:49.447722 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d1011d86-b173-4a92-ad8f-a21e0a28b536 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:49.448373 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d1011d86-b173-4a92-ad8f-a21e0a28b536 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:49.449383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d1011d86-b173-4a92-ad8f-a21e0a28b536 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:49.450099 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d1011d86-b173-4a92-ad8f-a21e0a28b536 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:49.599569 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell0:SELECT=4 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:50.164464 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d1011d86-b173-4a92-ad8f-a21e0a28b536 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:50.185838 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d1011d86-b173-4a92-ad8f-a21e0a28b536 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1315 microversion: 2.1 time: 0.767823 Aug 03 12:59:50.208487 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 22/45] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 12:59:49 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1315 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:59:50.426101 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-827b6310-d877-4237-9eb3-8f0d52ef1ff6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1146610562", "imageRef": "c0aabcc0-d4af-4f0e-b8a5-d140344fce1f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "62a2a8c1-4047-4249-9eca-1b469b6efbc6"}], "security_groups": [{"name": "tempest-securitygroup--150680958"}], "key_name": "tempest-keypair-488394907", "user_data": "}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:59:50.698346 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=2 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:50.895156 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.network.neutron [None req-827b6310-d877-4237-9eb3-8f0d52ef1ff6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] validate_networks() for [('62a2a8c1-4047-4249-9eca-1b469b6efbc6', None, None, None, None, None)] {{(pid=119410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 12:59:50.912517 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-00524080-fe3a-48b9-8024-4e510d77689f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Flavor limits 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 12:59:50.912517 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-00524080-fe3a-48b9-8024-4e510d77689f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Image limits 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 12:59:50.912517 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-00524080-fe3a-48b9-8024-4e510d77689f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Flavor pref 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 12:59:50.912517 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-00524080-fe3a-48b9-8024-4e510d77689f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Image pref 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 12:59:50.912517 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-00524080-fe3a-48b9-8024-4e510d77689f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 12:59:50.922907 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-00524080-fe3a-48b9-8024-4e510d77689f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:50.924080 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-00524080-fe3a-48b9-8024-4e510d77689f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:50.925187 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-00524080-fe3a-48b9-8024-4e510d77689f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:50.925835 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-00524080-fe3a-48b9-8024-4e510d77689f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:50.953524 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-00524080-fe3a-48b9-8024-4e510d77689f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Getting quotas for project 3a420d95334148b68d78a6497e0d95f5. Resources: {'instances', 'ram', 'cores'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:59:50.967451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-00524080-fe3a-48b9-8024-4e510d77689f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Getting quotas for user 6ec4b53cb3a64c3aa9cb6a186a61c1fe and project 3a420d95334148b68d78a6497e0d95f5. Resources: {'instances', 'ram', 'cores'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:59:50.997896 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-00524080-fe3a-48b9-8024-4e510d77689f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Going to run 1 instances... {{(pid=119409) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 12:59:51.002045 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-00524080-fe3a-48b9-8024-4e510d77689f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0aabcc0-d4af-4f0e-b8a5-d140344fce1f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 12:59:51.267377 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-00524080-fe3a-48b9-8024-4e510d77689f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.683461 Aug 03 12:59:51.269032 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 24/46] 10.222.0.64 () {62 vars in 1188 bytes} [Wed Aug 3 12:59:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 3686 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 12:59:51.289547 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ae00b854-090c-43ef-8fb9-de2a3541f61f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:51.304063 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-ae00b854-090c-43ef-8fb9-de2a3541f61f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:51.342719 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ae00b854-090c-43ef-8fb9-de2a3541f61f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:51.346337 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ae00b854-090c-43ef-8fb9-de2a3541f61f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:51.346604 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ae00b854-090c-43ef-8fb9-de2a3541f61f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:51.347275 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ae00b854-090c-43ef-8fb9-de2a3541f61f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:52.160372 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=10 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:52.720905 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ae00b854-090c-43ef-8fb9-de2a3541f61f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:52.759864 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-ae00b854-090c-43ef-8fb9-de2a3541f61f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1322 microversion: 2.1 time: 1.478593 Aug 03 12:59:52.767429 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 25/47] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 12:59:51 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1322 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:59:52.784071 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-9098b05c-249d-442b-b5ab-39fc3fd6a92e tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:52.790979 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-9098b05c-249d-442b-b5ab-39fc3fd6a92e tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:52.808774 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9098b05c-249d-442b-b5ab-39fc3fd6a92e tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:52.809692 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9098b05c-249d-442b-b5ab-39fc3fd6a92e tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:52.811262 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9098b05c-249d-442b-b5ab-39fc3fd6a92e tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:52.812966 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9098b05c-249d-442b-b5ab-39fc3fd6a92e tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:53.891951 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-827b6310-d877-4237-9eb3-8f0d52ef1ff6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Flavor limits 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 12:59:53.893196 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-827b6310-d877-4237-9eb3-8f0d52ef1ff6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Image limits 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 12:59:53.894479 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-827b6310-d877-4237-9eb3-8f0d52ef1ff6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Flavor pref 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 12:59:53.895159 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-827b6310-d877-4237-9eb3-8f0d52ef1ff6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Image pref 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 12:59:53.896439 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-827b6310-d877-4237-9eb3-8f0d52ef1ff6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 12:59:53.897686 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-9098b05c-249d-442b-b5ab-39fc3fd6a92e tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:53.909710 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-9098b05c-249d-442b-b5ab-39fc3fd6a92e tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1315 microversion: 2.1 time: 1.134202 Aug 03 12:59:53.936477 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 26/48] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 12:59:52 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1315 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:59:53.952400 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-bd4aeac7-cda1-4c07-8c67-12c0534cd08b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:53.953030 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-bd4aeac7-cda1-4c07-8c67-12c0534cd08b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:53.967505 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-827b6310-d877-4237-9eb3-8f0d52ef1ff6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:53.968094 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bd4aeac7-cda1-4c07-8c67-12c0534cd08b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:53.970889 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bd4aeac7-cda1-4c07-8c67-12c0534cd08b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:53.971721 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-827b6310-d877-4237-9eb3-8f0d52ef1ff6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:53.971846 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bd4aeac7-cda1-4c07-8c67-12c0534cd08b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:53.972222 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bd4aeac7-cda1-4c07-8c67-12c0534cd08b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:53.980274 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-827b6310-d877-4237-9eb3-8f0d52ef1ff6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:53.981921 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-827b6310-d877-4237-9eb3-8f0d52ef1ff6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:54.043975 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.quota [None req-827b6310-d877-4237-9eb3-8f0d52ef1ff6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Getting quotas for project 23cfcb8de5e448b8af185376a035263b. Resources: {'instances', 'ram', 'cores'} {{(pid=119410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:59:54.063381 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.quota [None req-827b6310-d877-4237-9eb3-8f0d52ef1ff6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Getting quotas for user 36693fa42a7b41279c8d8c59ecafb243 and project 23cfcb8de5e448b8af185376a035263b. Resources: {'instances', 'ram', 'cores'} {{(pid=119410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:59:54.097093 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-827b6310-d877-4237-9eb3-8f0d52ef1ff6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Going to run 1 instances... {{(pid=119410) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 12:59:54.099585 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-827b6310-d877-4237-9eb3-8f0d52ef1ff6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0aabcc0-d4af-4f0e-b8a5-d140344fce1f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 12:59:54.197731 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-bd4aeac7-cda1-4c07-8c67-12c0534cd08b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:54.221172 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-bd4aeac7-cda1-4c07-8c67-12c0534cd08b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:54.226180 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-bd4aeac7-cda1-4c07-8c67-12c0534cd08b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:54.234265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-bd4aeac7-cda1-4c07-8c67-12c0534cd08b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1277 microversion: 2.20 time: 0.291608 Aug 03 12:59:54.236606 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 27/49] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 12:59:53 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1277 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:59:54.395744 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-827b6310-d877-4237-9eb3-8f0d52ef1ff6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.985887 Aug 03 12:59:54.404649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 23/50] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 3 12:59:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 3995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 12:59:54.587104 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-fb952d90-7281-4d1a-b3db-d7dc8690cbf6 req-0d11f76a-ae73-4e2d-a31f-98d9db435d3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b39c466e-0f7f-48d9-accb-da8ecd932142", "tag": "bb8defef-013e-4d49-8621-5b924722dedc"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:59:54.630768 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:54.647306 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-fb952d90-7281-4d1a-b3db-d7dc8690cbf6 req-0d11f76a-ae73-4e2d-a31f-98d9db435d3b service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:54.648728 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-fb952d90-7281-4d1a-b3db-d7dc8690cbf6 req-0d11f76a-ae73-4e2d-a31f-98d9db435d3b service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:54.734440 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-fb952d90-7281-4d1a-b3db-d7dc8690cbf6 req-0d11f76a-ae73-4e2d-a31f-98d9db435d3b service nova] Creating event network-changed:bb8defef-013e-4d49-8621-5b924722dedc for instance b39c466e-0f7f-48d9-accb-da8ecd932142 on hv-cinder-85083 Aug 03 12:59:54.737627 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-fb952d90-7281-4d1a-b3db-d7dc8690cbf6 req-0d11f76a-ae73-4e2d-a31f-98d9db435d3b service nova] Acquired lock "compute-rpcapi-router" {{(pid=119409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 12:59:54.740000 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2eadfc38-78d5-4a75-a1ac-ac34b4cd9666 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:54.740807 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2eadfc38-78d5-4a75-a1ac-ac34b4cd9666 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:54.760086 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2eadfc38-78d5-4a75-a1ac-ac34b4cd9666 None None] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:54.760086 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2eadfc38-78d5-4a75-a1ac-ac34b4cd9666 None None] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:54.762591 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.compute.rpcapi [None req-2eadfc38-78d5-4a75-a1ac-ac34b4cd9666 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 03 12:59:54.763513 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2eadfc38-78d5-4a75-a1ac-ac34b4cd9666 None None] Releasing lock "compute-rpcapi-router" {{(pid=119409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 12:59:54.820666 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-2eadfc38-78d5-4a75-a1ac-ac34b4cd9666 None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.581495 Aug 03 12:59:54.821503 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 28/51] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 12:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:59:54.840519 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-5dc336fa-ce80-4e61-be68-4e286b899784 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:54.841417 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-5dc336fa-ce80-4e61-be68-4e286b899784 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:54.861876 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-7f2aa56b-4c9d-4160-bc48-33608c79f303 req-6b0f8c4d-56d3-4a09-ac66-97544135318d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db6cbbae-a113-4148-901c-8509aa6c1ef9", "tag": "2f56c840-bc27-4124-a3da-31ed38743b82"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:59:54.872642 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5dc336fa-ce80-4e61-be68-4e286b899784 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:54.875085 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5dc336fa-ce80-4e61-be68-4e286b899784 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:54.875915 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5dc336fa-ce80-4e61-be68-4e286b899784 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:54.879328 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5dc336fa-ce80-4e61-be68-4e286b899784 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:54.894310 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-7f2aa56b-4c9d-4160-bc48-33608c79f303 req-6b0f8c4d-56d3-4a09-ac66-97544135318d service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:54.902174 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-7f2aa56b-4c9d-4160-bc48-33608c79f303 req-6b0f8c4d-56d3-4a09-ac66-97544135318d service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:54.996055 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-7f2aa56b-4c9d-4160-bc48-33608c79f303 req-6b0f8c4d-56d3-4a09-ac66-97544135318d service nova] Creating event network-changed:2f56c840-bc27-4124-a3da-31ed38743b82 for instance db6cbbae-a113-4148-901c-8509aa6c1ef9 on hv-cinder-85083 Aug 03 12:59:54.996863 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-7f2aa56b-4c9d-4160-bc48-33608c79f303 req-6b0f8c4d-56d3-4a09-ac66-97544135318d service nova] Acquired lock "compute-rpcapi-router" {{(pid=119410) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 12:59:55.001251 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-09463d00-522f-410b-81a1-f9a9f1277350 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:55.002035 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-09463d00-522f-410b-81a1-f9a9f1277350 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:55.003119 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-09463d00-522f-410b-81a1-f9a9f1277350 None None] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:55.004901 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-09463d00-522f-410b-81a1-f9a9f1277350 None None] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:55.060025 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.compute.rpcapi [None req-09463d00-522f-410b-81a1-f9a9f1277350 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 03 12:59:55.062147 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-09463d00-522f-410b-81a1-f9a9f1277350 None None] Releasing lock "compute-rpcapi-router" {{(pid=119410) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 12:59:55.114433 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-09463d00-522f-410b-81a1-f9a9f1277350 None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.707805 Aug 03 12:59:55.116348 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 24/52] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 12:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:59:55.125680 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-632e3cbe-23a9-41d3-b213-d0c3158bb0d0 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:55.126380 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-632e3cbe-23a9-41d3-b213-d0c3158bb0d0 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:55.277113 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-632e3cbe-23a9-41d3-b213-d0c3158bb0d0 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:55.290495 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-632e3cbe-23a9-41d3-b213-d0c3158bb0d0 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1241 microversion: 2.1 time: 0.169705 Aug 03 12:59:55.291307 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 25/53] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 12:59:55 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1241 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:59:55.310225 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-c1119eb5-5d05-42f4-8213-74e44eb2b93b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:55.316616 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-c1119eb5-5d05-42f4-8213-74e44eb2b93b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:55.323552 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-5dc336fa-ce80-4e61-be68-4e286b899784 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:55.330566 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c1119eb5-5d05-42f4-8213-74e44eb2b93b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:55.331026 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c1119eb5-5d05-42f4-8213-74e44eb2b93b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:55.331807 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c1119eb5-5d05-42f4-8213-74e44eb2b93b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:55.332246 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c1119eb5-5d05-42f4-8213-74e44eb2b93b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:55.334334 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-5dc336fa-ce80-4e61-be68-4e286b899784 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1322 microversion: 2.1 time: 0.511270 Aug 03 12:59:55.335708 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 29/54] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 12:59:54 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1322 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:59:55.350699 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-f52c19ba-01a7-4f19-8cf3-912cc85866af tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:55.354631 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-f52c19ba-01a7-4f19-8cf3-912cc85866af tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:55.378022 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f52c19ba-01a7-4f19-8cf3-912cc85866af tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:55.380022 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f52c19ba-01a7-4f19-8cf3-912cc85866af tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:55.382075 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f52c19ba-01a7-4f19-8cf3-912cc85866af tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:55.382933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f52c19ba-01a7-4f19-8cf3-912cc85866af tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:55.550661 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-f52c19ba-01a7-4f19-8cf3-912cc85866af tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:55.566080 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-f52c19ba-01a7-4f19-8cf3-912cc85866af tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:55.568140 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-f52c19ba-01a7-4f19-8cf3-912cc85866af tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:55.584817 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-f52c19ba-01a7-4f19-8cf3-912cc85866af tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1333 microversion: 2.20 time: 0.231347 Aug 03 12:59:55.584817 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 30/55] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 12:59:55 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1333 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:59:55.686211 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c1119eb5-5d05-42f4-8213-74e44eb2b93b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:55.697528 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-c1119eb5-5d05-42f4-8213-74e44eb2b93b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1315 microversion: 2.1 time: 0.392665 Aug 03 12:59:55.698153 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 26/56] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 12:59:55 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:59:56.315949 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-3580ef0b-0ff8-4198-8ffc-cd7a03ee1844 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:56.316592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-3580ef0b-0ff8-4198-8ffc-cd7a03ee1844 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:56.325421 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3580ef0b-0ff8-4198-8ffc-cd7a03ee1844 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:56.326043 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3580ef0b-0ff8-4198-8ffc-cd7a03ee1844 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:56.326640 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3580ef0b-0ff8-4198-8ffc-cd7a03ee1844 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:56.331202 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3580ef0b-0ff8-4198-8ffc-cd7a03ee1844 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:56.359015 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-0d1657b6-30b7-4e04-abc0-8809237379a5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:56.359654 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-0d1657b6-30b7-4e04-abc0-8809237379a5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:56.371252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0d1657b6-30b7-4e04-abc0-8809237379a5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:56.371754 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0d1657b6-30b7-4e04-abc0-8809237379a5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:56.372504 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0d1657b6-30b7-4e04-abc0-8809237379a5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:56.372953 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0d1657b6-30b7-4e04-abc0-8809237379a5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:56.478193 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-3580ef0b-0ff8-4198-8ffc-cd7a03ee1844 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:56.486010 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-3580ef0b-0ff8-4198-8ffc-cd7a03ee1844 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1245 microversion: 2.1 time: 0.173812 Aug 03 12:59:56.487665 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 31/57] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 12:59:56 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1245 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:59:56.592494 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-8e13e66d-63b0-4aa9-be88-d9dcdfba3218 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:56.593113 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-8e13e66d-63b0-4aa9-be88-d9dcdfba3218 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:56.626032 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8e13e66d-63b0-4aa9-be88-d9dcdfba3218 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:56.626700 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8e13e66d-63b0-4aa9-be88-d9dcdfba3218 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:56.630428 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8e13e66d-63b0-4aa9-be88-d9dcdfba3218 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:56.630951 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8e13e66d-63b0-4aa9-be88-d9dcdfba3218 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:56.700925 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-0d1657b6-30b7-4e04-abc0-8809237379a5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:56.710097 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-0d1657b6-30b7-4e04-abc0-8809237379a5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1322 microversion: 2.1 time: 0.355836 Aug 03 12:59:56.714591 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 27/58] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 12:59:56 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1322 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:59:56.719421 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-dcd34370-5f85-453b-bb5c-8167c05b3426 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:56.720210 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-dcd34370-5f85-453b-bb5c-8167c05b3426 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:56.726727 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-dcd34370-5f85-453b-bb5c-8167c05b3426 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:56.728169 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-dcd34370-5f85-453b-bb5c-8167c05b3426 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:56.731605 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-dcd34370-5f85-453b-bb5c-8167c05b3426 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:56.732257 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-dcd34370-5f85-453b-bb5c-8167c05b3426 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:56.754032 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-8e13e66d-63b0-4aa9-be88-d9dcdfba3218 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:56.764476 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-8e13e66d-63b0-4aa9-be88-d9dcdfba3218 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:56.769952 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-8e13e66d-63b0-4aa9-be88-d9dcdfba3218 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:56.769952 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-8e13e66d-63b0-4aa9-be88-d9dcdfba3218 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1341 microversion: 2.20 time: 0.181641 Aug 03 12:59:56.782815 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 32/59] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 12:59:56 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1341 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:59:56.851915 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-d2fc524b-5d64-414e-8aa6-4069d36f56ac req-c4b7d613-7faf-47af-877c-4bd52bc48357 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20c576c6-074d-43df-b155-f95b3cd5bb79", "tag": "df70904f-7704-4b3b-b5b7-912d817eb793"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:59:56.866484 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-d2fc524b-5d64-414e-8aa6-4069d36f56ac req-c4b7d613-7faf-47af-877c-4bd52bc48357 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:56.867496 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-d2fc524b-5d64-414e-8aa6-4069d36f56ac req-c4b7d613-7faf-47af-877c-4bd52bc48357 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:56.887676 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-d2fc524b-5d64-414e-8aa6-4069d36f56ac req-c4b7d613-7faf-47af-877c-4bd52bc48357 service nova] Creating event network-changed:df70904f-7704-4b3b-b5b7-912d817eb793 for instance 20c576c6-074d-43df-b155-f95b3cd5bb79 on hv-cinder-85083 Aug 03 12:59:56.897347 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-d2fc524b-5d64-414e-8aa6-4069d36f56ac req-c4b7d613-7faf-47af-877c-4bd52bc48357 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048337 Aug 03 12:59:56.899889 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 33/60] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 12:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:59:56.929776 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-dcd34370-5f85-453b-bb5c-8167c05b3426 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:56.938519 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-dcd34370-5f85-453b-bb5c-8167c05b3426 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1315 microversion: 2.1 time: 0.222786 Aug 03 12:59:56.939338 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 28/61] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 12:59:56 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:59:57.534052 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-98cc0c47-3bf6-4166-a1ec-34515435e340 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:57.535917 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-98cc0c47-3bf6-4166-a1ec-34515435e340 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:57.548697 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-98cc0c47-3bf6-4166-a1ec-34515435e340 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:57.549977 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-98cc0c47-3bf6-4166-a1ec-34515435e340 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:57.550959 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-98cc0c47-3bf6-4166-a1ec-34515435e340 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:57.551793 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-98cc0c47-3bf6-4166-a1ec-34515435e340 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:57.732358 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-24c31e72-5f52-4fc5-93ed-8326279bb5fa tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:57.733584 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-24c31e72-5f52-4fc5-93ed-8326279bb5fa tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:57.748878 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-24c31e72-5f52-4fc5-93ed-8326279bb5fa tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:57.749876 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-24c31e72-5f52-4fc5-93ed-8326279bb5fa tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:57.750922 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-24c31e72-5f52-4fc5-93ed-8326279bb5fa tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:57.751591 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-24c31e72-5f52-4fc5-93ed-8326279bb5fa tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:57.888977 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-98cc0c47-3bf6-4166-a1ec-34515435e340 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:57.901338 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-98cc0c47-3bf6-4166-a1ec-34515435e340 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1245 microversion: 2.1 time: 0.388886 Aug 03 12:59:57.902143 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 34/62] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 12:59:57 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1245 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:59:57.916354 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-b1ef76c6-e00a-45ce-b7a2-bda3c1c0924d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:57.917328 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-b1ef76c6-e00a-45ce-b7a2-bda3c1c0924d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:57.928636 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b1ef76c6-e00a-45ce-b7a2-bda3c1c0924d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:57.929416 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b1ef76c6-e00a-45ce-b7a2-bda3c1c0924d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:57.931911 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b1ef76c6-e00a-45ce-b7a2-bda3c1c0924d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:57.933009 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b1ef76c6-e00a-45ce-b7a2-bda3c1c0924d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:58.112685 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b1ef76c6-e00a-45ce-b7a2-bda3c1c0924d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:58.121658 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b1ef76c6-e00a-45ce-b7a2-bda3c1c0924d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:58.133977 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b1ef76c6-e00a-45ce-b7a2-bda3c1c0924d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:58.137846 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-b1ef76c6-e00a-45ce-b7a2-bda3c1c0924d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1351 microversion: 2.20 time: 0.234484 Aug 03 12:59:58.138422 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 35/63] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 12:59:57 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1351 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:59:58.161312 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-c4fdb33a-20c9-4e16-96c9-7cebac639b5f tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:58.161931 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-c4fdb33a-20c9-4e16-96c9-7cebac639b5f tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:58.195083 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c4fdb33a-20c9-4e16-96c9-7cebac639b5f tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:58.195788 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c4fdb33a-20c9-4e16-96c9-7cebac639b5f tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:58.198544 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c4fdb33a-20c9-4e16-96c9-7cebac639b5f tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:58.200196 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c4fdb33a-20c9-4e16-96c9-7cebac639b5f tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:58.514337 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-24c31e72-5f52-4fc5-93ed-8326279bb5fa tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:58.526931 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-24c31e72-5f52-4fc5-93ed-8326279bb5fa tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1322 microversion: 2.1 time: 0.796343 Aug 03 12:59:58.528264 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 29/64] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 12:59:57 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1322 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:59:58.635327 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-c4fdb33a-20c9-4e16-96c9-7cebac639b5f tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:58.642784 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-c4fdb33a-20c9-4e16-96c9-7cebac639b5f tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1315 microversion: 2.1 time: 0.486207 Aug 03 12:59:58.643345 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 36/65] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 12:59:58 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1315 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:59:58.929459 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-fc0ccfa1-601c-4f75-a489-d01e1e0bcc4d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:58.930863 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-fc0ccfa1-601c-4f75-a489-d01e1e0bcc4d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:58.944126 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fc0ccfa1-601c-4f75-a489-d01e1e0bcc4d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:58.944586 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fc0ccfa1-601c-4f75-a489-d01e1e0bcc4d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:58.950889 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fc0ccfa1-601c-4f75-a489-d01e1e0bcc4d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:58.954719 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fc0ccfa1-601c-4f75-a489-d01e1e0bcc4d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:59.095329 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-fc0ccfa1-601c-4f75-a489-d01e1e0bcc4d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:59.115548 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-fc0ccfa1-601c-4f75-a489-d01e1e0bcc4d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1293 microversion: 2.1 time: 0.188180 Aug 03 12:59:59.119138 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 30/66] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 12:59:58 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1293 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:59:59.163678 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-acafa7eb-0228-4437-aa38-475ea778361a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:59.164596 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-acafa7eb-0228-4437-aa38-475ea778361a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:59.185280 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-acafa7eb-0228-4437-aa38-475ea778361a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:59.186886 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-acafa7eb-0228-4437-aa38-475ea778361a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:59.188229 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-acafa7eb-0228-4437-aa38-475ea778361a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:59.189106 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-acafa7eb-0228-4437-aa38-475ea778361a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:59.269839 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-acafa7eb-0228-4437-aa38-475ea778361a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:59.279293 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-acafa7eb-0228-4437-aa38-475ea778361a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:59.281413 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-acafa7eb-0228-4437-aa38-475ea778361a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:59.283565 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-acafa7eb-0228-4437-aa38-475ea778361a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1339 microversion: 2.20 time: 0.124974 Aug 03 12:59:59.284779 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 37/67] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 12:59:59 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1339 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:59:59.558006 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-8408c39e-0f3a-4be8-9a38-e2475189b8e1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:59.558006 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-8408c39e-0f3a-4be8-9a38-e2475189b8e1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:59.578253 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8408c39e-0f3a-4be8-9a38-e2475189b8e1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:59.581709 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8408c39e-0f3a-4be8-9a38-e2475189b8e1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:59.581709 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8408c39e-0f3a-4be8-9a38-e2475189b8e1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:59.581709 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8408c39e-0f3a-4be8-9a38-e2475189b8e1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:59.666615 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-b00b7887-3d2a-464d-9243-3b42b05afacd tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:59:59.667818 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-b00b7887-3d2a-464d-9243-3b42b05afacd tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:59:59.674004 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b00b7887-3d2a-464d-9243-3b42b05afacd tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:59.674452 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b00b7887-3d2a-464d-9243-3b42b05afacd tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:59.675250 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b00b7887-3d2a-464d-9243-3b42b05afacd tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:59:59.675685 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b00b7887-3d2a-464d-9243-3b42b05afacd tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:59:59.695195 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=100 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:59.835162 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-8408c39e-0f3a-4be8-9a38-e2475189b8e1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:59.846186 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-8408c39e-0f3a-4be8-9a38-e2475189b8e1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1322 microversion: 2.1 time: 0.299428 Aug 03 12:59:59.847117 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 31/68] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 12:59:59 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1322 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:59:59.894408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b00b7887-3d2a-464d-9243-3b42b05afacd tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:59:59.903433 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-b00b7887-3d2a-464d-9243-3b42b05afacd tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1315 microversion: 2.1 time: 0.243177 Aug 03 12:59:59.904231 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 38/69] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 12:59:59 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:00.145736 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-29deb578-4056-4740-8e55-9a3175d5b315 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:00.145736 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-29deb578-4056-4740-8e55-9a3175d5b315 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:00.151249 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-29deb578-4056-4740-8e55-9a3175d5b315 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:00.151887 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-29deb578-4056-4740-8e55-9a3175d5b315 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:00.152976 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-29deb578-4056-4740-8e55-9a3175d5b315 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:00.153789 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-29deb578-4056-4740-8e55-9a3175d5b315 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:00.216915 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-29deb578-4056-4740-8e55-9a3175d5b315 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:00.224173 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-29deb578-4056-4740-8e55-9a3175d5b315 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1293 microversion: 2.1 time: 0.086231 Aug 03 13:00:00.224722 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 32/70] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:00 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:00.311842 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-2a15cad0-7cc6-469e-8e49-8cfaf4f31fe5 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:00.312577 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-2a15cad0-7cc6-469e-8e49-8cfaf4f31fe5 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:00.318683 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2a15cad0-7cc6-469e-8e49-8cfaf4f31fe5 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:00.319175 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2a15cad0-7cc6-469e-8e49-8cfaf4f31fe5 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:00.319970 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2a15cad0-7cc6-469e-8e49-8cfaf4f31fe5 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:00.320408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2a15cad0-7cc6-469e-8e49-8cfaf4f31fe5 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:00.388420 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-2a15cad0-7cc6-469e-8e49-8cfaf4f31fe5 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:00.396600 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-2a15cad0-7cc6-469e-8e49-8cfaf4f31fe5 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:00.398114 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-2a15cad0-7cc6-469e-8e49-8cfaf4f31fe5 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:00.399538 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-2a15cad0-7cc6-469e-8e49-8cfaf4f31fe5 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1339 microversion: 2.20 time: 0.091679 Aug 03 13:00:00.400090 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 39/71] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:00 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1339 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:00.871042 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-4227bc7a-309c-410c-847f-420846a081a0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:00.872052 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-4227bc7a-309c-410c-847f-420846a081a0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:00.878920 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4227bc7a-309c-410c-847f-420846a081a0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:00.879378 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4227bc7a-309c-410c-847f-420846a081a0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:00.880207 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4227bc7a-309c-410c-847f-420846a081a0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:00.880675 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4227bc7a-309c-410c-847f-420846a081a0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:00.925387 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-c9240774-8d7e-4eac-8c50-33331e2a9090 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:00.926021 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-c9240774-8d7e-4eac-8c50-33331e2a9090 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:00.932714 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c9240774-8d7e-4eac-8c50-33331e2a9090 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:00.933155 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c9240774-8d7e-4eac-8c50-33331e2a9090 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:00.933909 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c9240774-8d7e-4eac-8c50-33331e2a9090 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:00.934332 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c9240774-8d7e-4eac-8c50-33331e2a9090 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:00.978043 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell0:SELECT=32 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:01.107213 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-4227bc7a-309c-410c-847f-420846a081a0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:01.125626 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-4227bc7a-309c-410c-847f-420846a081a0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1322 microversion: 2.1 time: 0.261127 Aug 03 13:00:01.126222 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 33/72] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:00 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:01.185661 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-c9240774-8d7e-4eac-8c50-33331e2a9090 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:01.193427 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-c9240774-8d7e-4eac-8c50-33331e2a9090 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1315 microversion: 2.1 time: 0.271814 Aug 03 13:00:01.207445 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 40/73] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:00 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:01.246353 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-2ce334ff-77f9-4cd0-9a67-8a3d600b96df tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:01.247363 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-2ce334ff-77f9-4cd0-9a67-8a3d600b96df tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:01.258523 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2ce334ff-77f9-4cd0-9a67-8a3d600b96df tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:01.259006 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2ce334ff-77f9-4cd0-9a67-8a3d600b96df tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:01.259788 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2ce334ff-77f9-4cd0-9a67-8a3d600b96df tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:01.260223 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2ce334ff-77f9-4cd0-9a67-8a3d600b96df tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:01.326265 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-2ce334ff-77f9-4cd0-9a67-8a3d600b96df tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:01.328586 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=91 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:01.334220 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-2ce334ff-77f9-4cd0-9a67-8a3d600b96df tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1293 microversion: 2.1 time: 0.092881 Aug 03 13:00:01.334798 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 34/74] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:01 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:01.421732 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-20836339-8bcd-4e87-ad3d-9421fbc5ab7c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:01.422628 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-20836339-8bcd-4e87-ad3d-9421fbc5ab7c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:01.428993 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-20836339-8bcd-4e87-ad3d-9421fbc5ab7c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:01.429446 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-20836339-8bcd-4e87-ad3d-9421fbc5ab7c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:01.430358 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-20836339-8bcd-4e87-ad3d-9421fbc5ab7c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:01.430826 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-20836339-8bcd-4e87-ad3d-9421fbc5ab7c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:01.495775 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-20836339-8bcd-4e87-ad3d-9421fbc5ab7c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:01.504583 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-20836339-8bcd-4e87-ad3d-9421fbc5ab7c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:01.508964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-20836339-8bcd-4e87-ad3d-9421fbc5ab7c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:01.508964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-20836339-8bcd-4e87-ad3d-9421fbc5ab7c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1339 microversion: 2.20 time: 0.089494 Aug 03 13:00:01.508964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 41/75] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:01 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1339 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:02.151770 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-de00a8de-ec77-43d5-9f10-df25a39c6458 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:02.151770 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-de00a8de-ec77-43d5-9f10-df25a39c6458 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:02.151770 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:02.153109 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-de00a8de-ec77-43d5-9f10-df25a39c6458 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:02.153561 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-de00a8de-ec77-43d5-9f10-df25a39c6458 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:02.154322 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-de00a8de-ec77-43d5-9f10-df25a39c6458 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:02.154785 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-de00a8de-ec77-43d5-9f10-df25a39c6458 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:02.217028 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-dd5e260b-17ad-45d3-8085-c464ea6b2859 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:02.217651 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-dd5e260b-17ad-45d3-8085-c464ea6b2859 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:02.223842 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-dd5e260b-17ad-45d3-8085-c464ea6b2859 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:02.224298 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-dd5e260b-17ad-45d3-8085-c464ea6b2859 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:02.225069 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-dd5e260b-17ad-45d3-8085-c464ea6b2859 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:02.225506 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-dd5e260b-17ad-45d3-8085-c464ea6b2859 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:02.326478 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-de00a8de-ec77-43d5-9f10-df25a39c6458 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:02.334764 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-de00a8de-ec77-43d5-9f10-df25a39c6458 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1322 microversion: 2.1 time: 0.193079 Aug 03 13:00:02.335358 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 35/76] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:02 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:02.357073 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-166fc176-546e-4392-9702-f698f16ae07c tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:02.357685 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-166fc176-546e-4392-9702-f698f16ae07c tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:02.363613 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-166fc176-546e-4392-9702-f698f16ae07c tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:02.364064 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-166fc176-546e-4392-9702-f698f16ae07c tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:02.364859 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-166fc176-546e-4392-9702-f698f16ae07c tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:02.365300 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-166fc176-546e-4392-9702-f698f16ae07c tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:02.383791 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-dd5e260b-17ad-45d3-8085-c464ea6b2859 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:02.391267 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-dd5e260b-17ad-45d3-8085-c464ea6b2859 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1315 microversion: 2.1 time: 0.178478 Aug 03 13:00:02.391915 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 42/77] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:02 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:00:02.426926 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-166fc176-546e-4392-9702-f698f16ae07c tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:02.435134 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-166fc176-546e-4392-9702-f698f16ae07c tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1293 microversion: 2.1 time: 0.083626 Aug 03 13:00:02.435738 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 36/78] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:02 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:00:02.531020 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-61fa6e79-da87-4de4-8c9f-7254c496494a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:02.531634 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-61fa6e79-da87-4de4-8c9f-7254c496494a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:02.538069 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-61fa6e79-da87-4de4-8c9f-7254c496494a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:02.538510 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-61fa6e79-da87-4de4-8c9f-7254c496494a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:02.542293 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-61fa6e79-da87-4de4-8c9f-7254c496494a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:02.542293 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-61fa6e79-da87-4de4-8c9f-7254c496494a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:02.600224 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-61fa6e79-da87-4de4-8c9f-7254c496494a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:02.611235 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-61fa6e79-da87-4de4-8c9f-7254c496494a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:02.611235 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-61fa6e79-da87-4de4-8c9f-7254c496494a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:02.611951 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-61fa6e79-da87-4de4-8c9f-7254c496494a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1339 microversion: 2.20 time: 0.084803 Aug 03 13:00:02.612520 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 43/79] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:02 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1339 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:03.360296 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-bc79966b-6b75-4fcb-88ac-a8f94a3ed1df tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:03.360976 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-bc79966b-6b75-4fcb-88ac-a8f94a3ed1df tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:03.373698 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bc79966b-6b75-4fcb-88ac-a8f94a3ed1df tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:03.374152 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bc79966b-6b75-4fcb-88ac-a8f94a3ed1df tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:03.374971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bc79966b-6b75-4fcb-88ac-a8f94a3ed1df tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:03.375412 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bc79966b-6b75-4fcb-88ac-a8f94a3ed1df tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:03.415910 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-8cdc5d55-a9f8-4a39-8e1b-e15ac3580675 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:03.417142 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-8cdc5d55-a9f8-4a39-8e1b-e15ac3580675 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:03.423298 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8cdc5d55-a9f8-4a39-8e1b-e15ac3580675 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:03.423766 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8cdc5d55-a9f8-4a39-8e1b-e15ac3580675 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:03.424854 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8cdc5d55-a9f8-4a39-8e1b-e15ac3580675 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:03.425299 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8cdc5d55-a9f8-4a39-8e1b-e15ac3580675 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:03.747613 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-bc79966b-6b75-4fcb-88ac-a8f94a3ed1df tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:03.760469 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-bc79966b-6b75-4fcb-88ac-a8f94a3ed1df tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1322 microversion: 2.1 time: 0.408573 Aug 03 13:00:03.761989 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 37/80] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:03 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1322 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:03.767282 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-65b7b5ca-43fd-416c-bc76-7ced516bfbd5 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:03.768589 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-65b7b5ca-43fd-416c-bc76-7ced516bfbd5 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:03.776758 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-65b7b5ca-43fd-416c-bc76-7ced516bfbd5 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:03.777408 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-65b7b5ca-43fd-416c-bc76-7ced516bfbd5 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:03.778875 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-65b7b5ca-43fd-416c-bc76-7ced516bfbd5 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:03.779867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-65b7b5ca-43fd-416c-bc76-7ced516bfbd5 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:03.780469 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-8cdc5d55-a9f8-4a39-8e1b-e15ac3580675 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:03.796160 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-8cdc5d55-a9f8-4a39-8e1b-e15ac3580675 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1315 microversion: 2.1 time: 0.382216 Aug 03 13:00:03.807956 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 44/81] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:03 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:00:03.821460 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-942008ff-43aa-4428-a81c-c73c92700801 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:03.824959 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-942008ff-43aa-4428-a81c-c73c92700801 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:03.835381 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-942008ff-43aa-4428-a81c-c73c92700801 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:03.839067 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-942008ff-43aa-4428-a81c-c73c92700801 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:03.839889 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-942008ff-43aa-4428-a81c-c73c92700801 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:03.840331 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-942008ff-43aa-4428-a81c-c73c92700801 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:03.941653 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-65b7b5ca-43fd-416c-bc76-7ced516bfbd5 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:03.971415 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-65b7b5ca-43fd-416c-bc76-7ced516bfbd5 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1301 microversion: 2.1 time: 0.194633 Aug 03 13:00:03.972361 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 38/82] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:03 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1301 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:04.043423 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-942008ff-43aa-4428-a81c-c73c92700801 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:04.056805 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-942008ff-43aa-4428-a81c-c73c92700801 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:04.061073 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-942008ff-43aa-4428-a81c-c73c92700801 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:04.064194 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-942008ff-43aa-4428-a81c-c73c92700801 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1339 microversion: 2.20 time: 0.254009 Aug 03 13:00:04.067557 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 45/83] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:03 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1339 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:04.781447 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-7196f70b-297c-49ad-b0cf-3a0e8843ff83 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:04.782294 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-7196f70b-297c-49ad-b0cf-3a0e8843ff83 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:04.788696 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7196f70b-297c-49ad-b0cf-3a0e8843ff83 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:04.789142 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7196f70b-297c-49ad-b0cf-3a0e8843ff83 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:04.789937 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7196f70b-297c-49ad-b0cf-3a0e8843ff83 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:04.790363 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7196f70b-297c-49ad-b0cf-3a0e8843ff83 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:04.815320 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-fa1d6cf2-7b50-409d-a0b8-d9d79f446a5a tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:04.815926 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-fa1d6cf2-7b50-409d-a0b8-d9d79f446a5a tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:04.817991 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell0:SELECT=4 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:04.827904 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fa1d6cf2-7b50-409d-a0b8-d9d79f446a5a tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:04.828357 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fa1d6cf2-7b50-409d-a0b8-d9d79f446a5a tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:04.829134 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fa1d6cf2-7b50-409d-a0b8-d9d79f446a5a tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:04.829568 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fa1d6cf2-7b50-409d-a0b8-d9d79f446a5a tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:04.987472 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-7196f70b-297c-49ad-b0cf-3a0e8843ff83 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:05.000767 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-7196f70b-297c-49ad-b0cf-3a0e8843ff83 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1322 microversion: 2.1 time: 0.220953 Aug 03 13:00:05.000767 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 39/84] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:04 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:05.007044 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d6685784-215f-44d0-a5be-f56c15880f5b tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:05.007910 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d6685784-215f-44d0-a5be-f56c15880f5b tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:05.013027 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-fa1d6cf2-7b50-409d-a0b8-d9d79f446a5a tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:05.015286 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d6685784-215f-44d0-a5be-f56c15880f5b tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:05.016010 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d6685784-215f-44d0-a5be-f56c15880f5b tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:05.016840 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d6685784-215f-44d0-a5be-f56c15880f5b tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:05.017422 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d6685784-215f-44d0-a5be-f56c15880f5b tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:05.021652 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-fa1d6cf2-7b50-409d-a0b8-d9d79f446a5a tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1315 microversion: 2.1 time: 0.210585 Aug 03 13:00:05.022230 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 46/85] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:04 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:00:05.064373 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=4 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:05.094004 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-5fbf9711-3646-4187-8a19-e0759e7047ce tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:05.095010 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-5fbf9711-3646-4187-8a19-e0759e7047ce tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:05.109842 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5fbf9711-3646-4187-8a19-e0759e7047ce tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:05.110403 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5fbf9711-3646-4187-8a19-e0759e7047ce tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:05.111323 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5fbf9711-3646-4187-8a19-e0759e7047ce tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:05.113544 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5fbf9711-3646-4187-8a19-e0759e7047ce tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:05.282430 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=8 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:05.426352 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d6685784-215f-44d0-a5be-f56c15880f5b tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:05.434370 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d6685784-215f-44d0-a5be-f56c15880f5b tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1378 microversion: 2.1 time: 0.433999 Aug 03 13:00:05.435068 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 40/86] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:04 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1378 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:05.450562 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-5fbf9711-3646-4187-8a19-e0759e7047ce tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:05.458996 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-5fbf9711-3646-4187-8a19-e0759e7047ce tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:05.460631 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-5fbf9711-3646-4187-8a19-e0759e7047ce tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:05.462231 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-5fbf9711-3646-4187-8a19-e0759e7047ce tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.372188 Aug 03 13:00:05.462803 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 47/87] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:05 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:06.020324 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-adf82713-51db-4958-81cf-df54b14a9da2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:06.027956 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-adf82713-51db-4958-81cf-df54b14a9da2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:06.027956 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-adf82713-51db-4958-81cf-df54b14a9da2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:06.028334 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-adf82713-51db-4958-81cf-df54b14a9da2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:06.029028 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-adf82713-51db-4958-81cf-df54b14a9da2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:06.029459 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-adf82713-51db-4958-81cf-df54b14a9da2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:06.042753 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-c14845a8-844e-419c-8724-548e20c91622 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:06.043521 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-c14845a8-844e-419c-8724-548e20c91622 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:06.051096 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c14845a8-844e-419c-8724-548e20c91622 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:06.054404 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c14845a8-844e-419c-8724-548e20c91622 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:06.054404 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c14845a8-844e-419c-8724-548e20c91622 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:06.054404 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c14845a8-844e-419c-8724-548e20c91622 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:06.250306 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-adf82713-51db-4958-81cf-df54b14a9da2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:06.253928 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-c14845a8-844e-419c-8724-548e20c91622 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:06.257587 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-adf82713-51db-4958-81cf-df54b14a9da2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1322 microversion: 2.1 time: 0.241097 Aug 03 13:00:06.258776 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 41/88] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:06 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:06.261359 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-c14845a8-844e-419c-8724-548e20c91622 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1315 microversion: 2.1 time: 0.222579 Aug 03 13:00:06.261917 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 48/89] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:06 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:06.455560 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-80d7b611-c3d6-4496-a958-fe58590f34f9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:06.456161 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-80d7b611-c3d6-4496-a958-fe58590f34f9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:06.462123 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-80d7b611-c3d6-4496-a958-fe58590f34f9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:06.462563 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-80d7b611-c3d6-4496-a958-fe58590f34f9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:06.463375 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-80d7b611-c3d6-4496-a958-fe58590f34f9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:06.463819 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-80d7b611-c3d6-4496-a958-fe58590f34f9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:06.485307 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d5a9767c-c3ea-472b-bea7-5fb4469c0f0c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:06.485905 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-d5a9767c-c3ea-472b-bea7-5fb4469c0f0c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:06.491860 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d5a9767c-c3ea-472b-bea7-5fb4469c0f0c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:06.492295 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d5a9767c-c3ea-472b-bea7-5fb4469c0f0c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:06.493567 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d5a9767c-c3ea-472b-bea7-5fb4469c0f0c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:06.493990 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d5a9767c-c3ea-472b-bea7-5fb4469c0f0c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:06.642999 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-80d7b611-c3d6-4496-a958-fe58590f34f9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:06.650568 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-80d7b611-c3d6-4496-a958-fe58590f34f9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1378 microversion: 2.1 time: 0.199157 Aug 03 13:00:06.664205 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 42/90] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:06 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1378 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:06.668922 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-d5a9767c-c3ea-472b-bea7-5fb4469c0f0c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:06.676850 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-d5a9767c-c3ea-472b-bea7-5fb4469c0f0c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:06.678335 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-d5a9767c-c3ea-472b-bea7-5fb4469c0f0c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:06.679448 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-d5a9767c-c3ea-472b-bea7-5fb4469c0f0c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.198027 Aug 03 13:00:06.680657 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 49/91] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:06 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:00:07.279722 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-b12349f2-d9bb-43e2-b6ed-6a631bc705fc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:07.280331 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-b12349f2-d9bb-43e2-b6ed-6a631bc705fc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:07.286899 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b12349f2-d9bb-43e2-b6ed-6a631bc705fc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:07.287366 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b12349f2-d9bb-43e2-b6ed-6a631bc705fc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:07.288499 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-247eba1a-0e6f-4ed4-bbda-5d158ab76489 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:07.288909 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b12349f2-d9bb-43e2-b6ed-6a631bc705fc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:07.288909 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b12349f2-d9bb-43e2-b6ed-6a631bc705fc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:07.289055 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-247eba1a-0e6f-4ed4-bbda-5d158ab76489 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:07.295814 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-247eba1a-0e6f-4ed4-bbda-5d158ab76489 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:07.298596 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-247eba1a-0e6f-4ed4-bbda-5d158ab76489 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:07.298596 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-247eba1a-0e6f-4ed4-bbda-5d158ab76489 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:07.298596 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-247eba1a-0e6f-4ed4-bbda-5d158ab76489 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:07.487550 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-b12349f2-d9bb-43e2-b6ed-6a631bc705fc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:07.490300 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-247eba1a-0e6f-4ed4-bbda-5d158ab76489 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:07.496427 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-b12349f2-d9bb-43e2-b6ed-6a631bc705fc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1322 microversion: 2.1 time: 0.220100 Aug 03 13:00:07.496427 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 43/92] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:07 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:07.498940 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-247eba1a-0e6f-4ed4-bbda-5d158ab76489 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1315 microversion: 2.1 time: 0.214459 Aug 03 13:00:07.504406 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 50/93] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:07 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:07.671197 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-18ce555e-f49a-4ca6-85fe-5f8d3f09de72 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:07.671809 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-18ce555e-f49a-4ca6-85fe-5f8d3f09de72 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:07.678006 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-18ce555e-f49a-4ca6-85fe-5f8d3f09de72 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:07.678461 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-18ce555e-f49a-4ca6-85fe-5f8d3f09de72 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:07.679245 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-18ce555e-f49a-4ca6-85fe-5f8d3f09de72 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:07.679732 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-18ce555e-f49a-4ca6-85fe-5f8d3f09de72 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:07.703020 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-317a888a-b20d-44f2-9318-d65d7056c5d7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:07.703632 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-317a888a-b20d-44f2-9318-d65d7056c5d7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:07.711015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-317a888a-b20d-44f2-9318-d65d7056c5d7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:07.712602 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-317a888a-b20d-44f2-9318-d65d7056c5d7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:07.713383 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-317a888a-b20d-44f2-9318-d65d7056c5d7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:07.714163 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-317a888a-b20d-44f2-9318-d65d7056c5d7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:07.865143 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-18ce555e-f49a-4ca6-85fe-5f8d3f09de72 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:07.872979 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-18ce555e-f49a-4ca6-85fe-5f8d3f09de72 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1378 microversion: 2.1 time: 0.205688 Aug 03 13:00:07.873692 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 44/94] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:07 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1378 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:07.888448 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-317a888a-b20d-44f2-9318-d65d7056c5d7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:07.896985 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-317a888a-b20d-44f2-9318-d65d7056c5d7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:07.897801 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-317a888a-b20d-44f2-9318-d65d7056c5d7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:07.898945 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-317a888a-b20d-44f2-9318-d65d7056c5d7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.199827 Aug 03 13:00:07.899490 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 51/95] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:07 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:00:08.516860 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-be003f62-601a-4c42-941a-1bea4430a926 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:08.517460 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-be003f62-601a-4c42-941a-1bea4430a926 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:08.524217 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-be003f62-601a-4c42-941a-1bea4430a926 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:08.524762 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-be003f62-601a-4c42-941a-1bea4430a926 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:08.525065 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-38501962-7dee-4426-84a2-4a5e19966628 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:08.525511 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-be003f62-601a-4c42-941a-1bea4430a926 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:08.525738 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-38501962-7dee-4426-84a2-4a5e19966628 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:08.525938 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-be003f62-601a-4c42-941a-1bea4430a926 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:08.531720 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-38501962-7dee-4426-84a2-4a5e19966628 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:08.532451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-38501962-7dee-4426-84a2-4a5e19966628 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:08.533208 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-38501962-7dee-4426-84a2-4a5e19966628 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:08.533642 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-38501962-7dee-4426-84a2-4a5e19966628 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:08.723583 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-be003f62-601a-4c42-941a-1bea4430a926 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:08.726770 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-38501962-7dee-4426-84a2-4a5e19966628 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:08.736209 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-38501962-7dee-4426-84a2-4a5e19966628 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1315 microversion: 2.1 time: 0.216052 Aug 03 13:00:08.737243 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 52/96] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:08 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:00:08.745280 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-be003f62-601a-4c42-941a-1bea4430a926 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1322 microversion: 2.1 time: 0.232190 Aug 03 13:00:08.745849 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 45/97] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:08 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:08.894184 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-78c508f9-3234-4922-9e54-dbbf6d37be68 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:08.894813 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-78c508f9-3234-4922-9e54-dbbf6d37be68 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:08.901426 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-78c508f9-3234-4922-9e54-dbbf6d37be68 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:08.901864 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-78c508f9-3234-4922-9e54-dbbf6d37be68 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:08.902638 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-78c508f9-3234-4922-9e54-dbbf6d37be68 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:08.903089 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-78c508f9-3234-4922-9e54-dbbf6d37be68 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:08.921558 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-0f48ce81-6e1f-427f-bbe6-11d6c01285c3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:08.922377 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-0f48ce81-6e1f-427f-bbe6-11d6c01285c3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:08.930254 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0f48ce81-6e1f-427f-bbe6-11d6c01285c3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:08.930254 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0f48ce81-6e1f-427f-bbe6-11d6c01285c3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:08.930254 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0f48ce81-6e1f-427f-bbe6-11d6c01285c3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:08.930973 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0f48ce81-6e1f-427f-bbe6-11d6c01285c3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:09.109066 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-78c508f9-3234-4922-9e54-dbbf6d37be68 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:09.112771 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-0f48ce81-6e1f-427f-bbe6-11d6c01285c3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:09.116676 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-78c508f9-3234-4922-9e54-dbbf6d37be68 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1378 microversion: 2.1 time: 0.226295 Aug 03 13:00:09.117297 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 53/98] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:08 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1378 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:09.120757 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-0f48ce81-6e1f-427f-bbe6-11d6c01285c3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:09.122501 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-0f48ce81-6e1f-427f-bbe6-11d6c01285c3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:09.123616 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-0f48ce81-6e1f-427f-bbe6-11d6c01285c3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.206106 Aug 03 13:00:09.124155 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 46/99] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:08 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:00:09.756451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-41e2a4c9-f93c-4c80-a959-de483ecfcc77 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:09.757062 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-41e2a4c9-f93c-4c80-a959-de483ecfcc77 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:09.765481 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-f2c7de7a-7183-43fe-b84e-ccae7fb9e905 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:09.766090 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-f2c7de7a-7183-43fe-b84e-ccae7fb9e905 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:09.767040 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-41e2a4c9-f93c-4c80-a959-de483ecfcc77 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:09.767495 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-41e2a4c9-f93c-4c80-a959-de483ecfcc77 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:09.768274 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-41e2a4c9-f93c-4c80-a959-de483ecfcc77 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:09.768703 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-41e2a4c9-f93c-4c80-a959-de483ecfcc77 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:09.772501 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f2c7de7a-7183-43fe-b84e-ccae7fb9e905 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:09.773210 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f2c7de7a-7183-43fe-b84e-ccae7fb9e905 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:09.773981 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f2c7de7a-7183-43fe-b84e-ccae7fb9e905 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:09.774415 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f2c7de7a-7183-43fe-b84e-ccae7fb9e905 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:09.979358 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-f2c7de7a-7183-43fe-b84e-ccae7fb9e905 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:10.005109 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-41e2a4c9-f93c-4c80-a959-de483ecfcc77 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:10.005109 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-41e2a4c9-f93c-4c80-a959-de483ecfcc77 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1315 microversion: 2.1 time: 0.235420 Aug 03 13:00:10.005517 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-f2c7de7a-7183-43fe-b84e-ccae7fb9e905 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1322 microversion: 2.1 time: 0.226961 Aug 03 13:00:10.005620 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 54/100] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:09 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:10.005737 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 47/101] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:09 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:00:10.146186 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-ffa0113c-4bc0-40b6-9cef-c5a949756621 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:10.146909 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-ffa0113c-4bc0-40b6-9cef-c5a949756621 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:10.151916 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-c7977f46-53dc-420d-bf44-9c6bf86dd1fd tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:10.152720 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-c7977f46-53dc-420d-bf44-9c6bf86dd1fd tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:10.154264 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ffa0113c-4bc0-40b6-9cef-c5a949756621 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:10.154716 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ffa0113c-4bc0-40b6-9cef-c5a949756621 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:10.155763 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ffa0113c-4bc0-40b6-9cef-c5a949756621 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:10.155948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ffa0113c-4bc0-40b6-9cef-c5a949756621 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:10.159272 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c7977f46-53dc-420d-bf44-9c6bf86dd1fd tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:10.160192 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c7977f46-53dc-420d-bf44-9c6bf86dd1fd tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:10.160477 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c7977f46-53dc-420d-bf44-9c6bf86dd1fd tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:10.160902 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c7977f46-53dc-420d-bf44-9c6bf86dd1fd tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:10.165579 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=100 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:10.378790 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ffa0113c-4bc0-40b6-9cef-c5a949756621 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:10.379848 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-c7977f46-53dc-420d-bf44-9c6bf86dd1fd tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:10.379848 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-c7977f46-53dc-420d-bf44-9c6bf86dd1fd tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1378 microversion: 2.1 time: 0.229782 Aug 03 13:00:10.380970 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ffa0113c-4bc0-40b6-9cef-c5a949756621 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:10.381544 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 55/102] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:10 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1378 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:10.382058 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ffa0113c-4bc0-40b6-9cef-c5a949756621 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:10.382058 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-ffa0113c-4bc0-40b6-9cef-c5a949756621 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.229897 Aug 03 13:00:10.382058 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 48/103] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:10 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:11.022122 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-00d4f0d8-5539-48f7-b915-5269b2bae900 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:11.022886 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-00d4f0d8-5539-48f7-b915-5269b2bae900 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:11.029356 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-00d4f0d8-5539-48f7-b915-5269b2bae900 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:11.029855 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-00d4f0d8-5539-48f7-b915-5269b2bae900 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:11.030582 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-00d4f0d8-5539-48f7-b915-5269b2bae900 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:11.031066 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-00d4f0d8-5539-48f7-b915-5269b2bae900 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:11.034494 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-44469be7-f112-46b8-9254-9e0af454617a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:11.035136 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-44469be7-f112-46b8-9254-9e0af454617a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:11.041858 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-44469be7-f112-46b8-9254-9e0af454617a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:11.042317 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-44469be7-f112-46b8-9254-9e0af454617a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:11.043115 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-44469be7-f112-46b8-9254-9e0af454617a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:11.043556 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-44469be7-f112-46b8-9254-9e0af454617a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:11.229996 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-00d4f0d8-5539-48f7-b915-5269b2bae900 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:11.236753 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-44469be7-f112-46b8-9254-9e0af454617a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:11.237449 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-00d4f0d8-5539-48f7-b915-5269b2bae900 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1315 microversion: 2.1 time: 0.219573 Aug 03 13:00:11.238020 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 56/104] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:11 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:00:11.244908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-44469be7-f112-46b8-9254-9e0af454617a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1322 microversion: 2.1 time: 0.214548 Aug 03 13:00:11.245470 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 49/105] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:11 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:00:11.397268 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-483ba7da-9939-4d2b-8bf4-2472147816d3 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:11.397814 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-483ba7da-9939-4d2b-8bf4-2472147816d3 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:11.403752 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-483ba7da-9939-4d2b-8bf4-2472147816d3 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:11.404196 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-483ba7da-9939-4d2b-8bf4-2472147816d3 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:11.404950 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-483ba7da-9939-4d2b-8bf4-2472147816d3 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:11.405381 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-483ba7da-9939-4d2b-8bf4-2472147816d3 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:11.411252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-00f3988d-a853-4538-9b67-e8ee1bc6e528 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:11.411895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-00f3988d-a853-4538-9b67-e8ee1bc6e528 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:11.418290 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-00f3988d-a853-4538-9b67-e8ee1bc6e528 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:11.418754 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-00f3988d-a853-4538-9b67-e8ee1bc6e528 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:11.419543 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-00f3988d-a853-4538-9b67-e8ee1bc6e528 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:11.419972 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-00f3988d-a853-4538-9b67-e8ee1bc6e528 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:11.606479 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-483ba7da-9939-4d2b-8bf4-2472147816d3 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:11.609649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-00f3988d-a853-4538-9b67-e8ee1bc6e528 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:11.614113 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-483ba7da-9939-4d2b-8bf4-2472147816d3 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1378 microversion: 2.1 time: 0.220717 Aug 03 13:00:11.614786 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 57/106] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:11 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1378 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:11.618403 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-00f3988d-a853-4538-9b67-e8ee1bc6e528 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:11.619920 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-00f3988d-a853-4538-9b67-e8ee1bc6e528 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:11.621008 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-00f3988d-a853-4538-9b67-e8ee1bc6e528 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.213879 Aug 03 13:00:11.621548 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 50/107] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:11 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:00:12.258830 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-e7770320-df52-4eae-a5f0-81fbdd4f510b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:12.259432 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-e7770320-df52-4eae-a5f0-81fbdd4f510b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:12.264765 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-be244b6e-95c1-42b1-a9ab-1fb4c023049d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:12.265378 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-be244b6e-95c1-42b1-a9ab-1fb4c023049d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:12.265601 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e7770320-df52-4eae-a5f0-81fbdd4f510b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:12.266043 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e7770320-df52-4eae-a5f0-81fbdd4f510b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:12.266828 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e7770320-df52-4eae-a5f0-81fbdd4f510b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:12.267258 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e7770320-df52-4eae-a5f0-81fbdd4f510b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:12.271387 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-be244b6e-95c1-42b1-a9ab-1fb4c023049d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:12.271835 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-be244b6e-95c1-42b1-a9ab-1fb4c023049d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:12.272604 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-be244b6e-95c1-42b1-a9ab-1fb4c023049d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:12.273039 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-be244b6e-95c1-42b1-a9ab-1fb4c023049d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:12.288175 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=100 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:12.456533 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-e7770320-df52-4eae-a5f0-81fbdd4f510b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:12.463879 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-be244b6e-95c1-42b1-a9ab-1fb4c023049d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:12.464299 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-e7770320-df52-4eae-a5f0-81fbdd4f510b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1315 microversion: 2.1 time: 0.209247 Aug 03 13:00:12.464955 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 58/108] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:12 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:12.477112 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-be244b6e-95c1-42b1-a9ab-1fb4c023049d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1322 microversion: 2.1 time: 0.215490 Aug 03 13:00:12.477863 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 51/109] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:12 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:00:12.635311 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-32e9c549-a559-4e49-bdd7-76e67b2a6299 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:12.635913 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-32e9c549-a559-4e49-bdd7-76e67b2a6299 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:12.641999 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-32e9c549-a559-4e49-bdd7-76e67b2a6299 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:12.642440 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-32e9c549-a559-4e49-bdd7-76e67b2a6299 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:12.642579 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-93d2a18b-bd6f-4d5b-8007-5825411209a5 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:12.643268 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-93d2a18b-bd6f-4d5b-8007-5825411209a5 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:12.643372 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-32e9c549-a559-4e49-bdd7-76e67b2a6299 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:12.643697 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-32e9c549-a559-4e49-bdd7-76e67b2a6299 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:12.649824 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-93d2a18b-bd6f-4d5b-8007-5825411209a5 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:12.650269 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-93d2a18b-bd6f-4d5b-8007-5825411209a5 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:12.651092 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-93d2a18b-bd6f-4d5b-8007-5825411209a5 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:12.651526 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-93d2a18b-bd6f-4d5b-8007-5825411209a5 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:12.833392 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-32e9c549-a559-4e49-bdd7-76e67b2a6299 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:12.836833 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-93d2a18b-bd6f-4d5b-8007-5825411209a5 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:12.841508 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-32e9c549-a559-4e49-bdd7-76e67b2a6299 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1378 microversion: 2.1 time: 0.210563 Aug 03 13:00:12.842083 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 59/110] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:12 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1378 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:12.845033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-93d2a18b-bd6f-4d5b-8007-5825411209a5 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:12.846622 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-93d2a18b-bd6f-4d5b-8007-5825411209a5 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:12.847818 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-93d2a18b-bd6f-4d5b-8007-5825411209a5 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.209103 Aug 03 13:00:12.848505 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 52/111] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:12 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:00:13.485341 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d32aa56c-fe97-41a9-b4ab-2f554351973b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:13.485956 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-d32aa56c-fe97-41a9-b4ab-2f554351973b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:13.493166 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d32aa56c-fe97-41a9-b4ab-2f554351973b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:13.493640 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d32aa56c-fe97-41a9-b4ab-2f554351973b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:13.494420 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d32aa56c-fe97-41a9-b4ab-2f554351973b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:13.494887 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d32aa56c-fe97-41a9-b4ab-2f554351973b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:13.498158 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-c0beed0d-3f5e-4b26-84d3-ccfd1fabd271 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:13.498789 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-c0beed0d-3f5e-4b26-84d3-ccfd1fabd271 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:13.505047 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c0beed0d-3f5e-4b26-84d3-ccfd1fabd271 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:13.505494 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c0beed0d-3f5e-4b26-84d3-ccfd1fabd271 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:13.506374 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c0beed0d-3f5e-4b26-84d3-ccfd1fabd271 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:13.506944 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c0beed0d-3f5e-4b26-84d3-ccfd1fabd271 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:13.853671 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-d32aa56c-fe97-41a9-b4ab-2f554351973b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:13.857560 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c0beed0d-3f5e-4b26-84d3-ccfd1fabd271 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:13.863138 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-d32aa56c-fe97-41a9-b4ab-2f554351973b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1315 microversion: 2.1 time: 0.381322 Aug 03 13:00:13.863717 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 60/112] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:13 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:13.868593 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-c3582c96-f4ec-402a-8a7e-c2a3a03af0ba tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:13.869189 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-c3582c96-f4ec-402a-8a7e-c2a3a03af0ba tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:13.875296 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c3582c96-f4ec-402a-8a7e-c2a3a03af0ba tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:13.875734 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c3582c96-f4ec-402a-8a7e-c2a3a03af0ba tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:13.876492 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c3582c96-f4ec-402a-8a7e-c2a3a03af0ba tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:13.876916 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c3582c96-f4ec-402a-8a7e-c2a3a03af0ba tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:13.881277 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-c0beed0d-3f5e-4b26-84d3-ccfd1fabd271 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1322 microversion: 2.1 time: 0.386850 Aug 03 13:00:13.882173 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 53/113] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:13 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1322 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:00:13.886820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e4e8db3a-c1cf-40b5-9c7c-8f975af4c14b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:13.887811 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-e4e8db3a-c1cf-40b5-9c7c-8f975af4c14b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:13.894599 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e4e8db3a-c1cf-40b5-9c7c-8f975af4c14b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:13.895201 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e4e8db3a-c1cf-40b5-9c7c-8f975af4c14b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:13.896073 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e4e8db3a-c1cf-40b5-9c7c-8f975af4c14b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:13.897095 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e4e8db3a-c1cf-40b5-9c7c-8f975af4c14b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:14.087893 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-c3582c96-f4ec-402a-8a7e-c2a3a03af0ba tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:14.091571 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-e4e8db3a-c1cf-40b5-9c7c-8f975af4c14b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:14.095508 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-c3582c96-f4ec-402a-8a7e-c2a3a03af0ba tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1366 microversion: 2.1 time: 0.230796 Aug 03 13:00:14.096424 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 61/114] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:13 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:14.099748 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-e4e8db3a-c1cf-40b5-9c7c-8f975af4c14b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:14.101361 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-e4e8db3a-c1cf-40b5-9c7c-8f975af4c14b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:14.103120 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-e4e8db3a-c1cf-40b5-9c7c-8f975af4c14b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.220067 Aug 03 13:00:14.103776 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 54/115] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:13 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:14.886851 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-399e393f-6b2d-4618-ad1a-19666d8c91a1 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:14.887420 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-399e393f-6b2d-4618-ad1a-19666d8c91a1 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:14.893718 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-399e393f-6b2d-4618-ad1a-19666d8c91a1 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:14.894174 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-399e393f-6b2d-4618-ad1a-19666d8c91a1 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:14.894980 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-399e393f-6b2d-4618-ad1a-19666d8c91a1 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:14.895416 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-399e393f-6b2d-4618-ad1a-19666d8c91a1 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:14.901410 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-71d7ba2a-8aff-45b3-9d69-24622a57aed1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:14.902921 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-71d7ba2a-8aff-45b3-9d69-24622a57aed1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:14.909500 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-71d7ba2a-8aff-45b3-9d69-24622a57aed1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:14.910243 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-71d7ba2a-8aff-45b3-9d69-24622a57aed1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:14.911153 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-71d7ba2a-8aff-45b3-9d69-24622a57aed1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:14.911792 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-71d7ba2a-8aff-45b3-9d69-24622a57aed1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:15.136231 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-399e393f-6b2d-4618-ad1a-19666d8c91a1 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:15.143175 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-71d7ba2a-8aff-45b3-9d69-24622a57aed1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:15.145845 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-399e393f-6b2d-4618-ad1a-19666d8c91a1 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1315 microversion: 2.1 time: 0.263156 Aug 03 13:00:15.146853 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 62/116] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:14 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:15.155025 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-10c5fc32-7f23-414d-befb-89dd35e84051 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:15.156018 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-10c5fc32-7f23-414d-befb-89dd35e84051 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:15.165048 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-71d7ba2a-8aff-45b3-9d69-24622a57aed1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1322 microversion: 2.1 time: 0.267358 Aug 03 13:00:15.166334 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 55/117] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:14 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:00:15.171524 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-789d3039-9be8-4cd3-bd5c-184e560aa056 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:15.172343 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-789d3039-9be8-4cd3-bd5c-184e560aa056 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:15.179033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-789d3039-9be8-4cd3-bd5c-184e560aa056 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:15.180255 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-789d3039-9be8-4cd3-bd5c-184e560aa056 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:15.181234 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-789d3039-9be8-4cd3-bd5c-184e560aa056 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:15.181366 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-10c5fc32-7f23-414d-befb-89dd35e84051 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:15.181733 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-10c5fc32-7f23-414d-befb-89dd35e84051 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:15.182225 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-789d3039-9be8-4cd3-bd5c-184e560aa056 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:15.182569 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-10c5fc32-7f23-414d-befb-89dd35e84051 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:15.183124 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-10c5fc32-7f23-414d-befb-89dd35e84051 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:15.415174 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-789d3039-9be8-4cd3-bd5c-184e560aa056 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:15.425173 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-789d3039-9be8-4cd3-bd5c-184e560aa056 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:15.426827 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-789d3039-9be8-4cd3-bd5c-184e560aa056 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:15.428001 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-789d3039-9be8-4cd3-bd5c-184e560aa056 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.260415 Aug 03 13:00:15.428984 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 56/118] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:15 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:15.447559 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-10c5fc32-7f23-414d-befb-89dd35e84051 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:15.455731 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-10c5fc32-7f23-414d-befb-89dd35e84051 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1366 microversion: 2.1 time: 0.307643 Aug 03 13:00:15.456658 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 63/119] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:15 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1366 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:15.615820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-b8541db3-95be-4d3d-88e8-bb4194fba59b req-98191246-4bf0-4f52-bdc2-6fc01fbcc746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db6cbbae-a113-4148-901c-8509aa6c1ef9", "name": "network-vif-plugged", "status": "completed", "tag": "2f56c840-bc27-4124-a3da-31ed38743b82"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:00:15.626274 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-b8541db3-95be-4d3d-88e8-bb4194fba59b req-98191246-4bf0-4f52-bdc2-6fc01fbcc746 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:15.626717 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-b8541db3-95be-4d3d-88e8-bb4194fba59b req-98191246-4bf0-4f52-bdc2-6fc01fbcc746 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:15.640353 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-b8541db3-95be-4d3d-88e8-bb4194fba59b req-98191246-4bf0-4f52-bdc2-6fc01fbcc746 service nova] Creating event network-vif-plugged:2f56c840-bc27-4124-a3da-31ed38743b82 for instance db6cbbae-a113-4148-901c-8509aa6c1ef9 on hv-cinder-85083 Aug 03 13:00:15.645888 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-b8541db3-95be-4d3d-88e8-bb4194fba59b req-98191246-4bf0-4f52-bdc2-6fc01fbcc746 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095614 Aug 03 13:00:15.648396 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 57/120] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:00:16.170108 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-63729101-3630-45b3-a97b-44349fe7da8e tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:16.170799 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-63729101-3630-45b3-a97b-44349fe7da8e tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:16.176951 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-63729101-3630-45b3-a97b-44349fe7da8e tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:16.177401 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-63729101-3630-45b3-a97b-44349fe7da8e tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:16.178163 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-63729101-3630-45b3-a97b-44349fe7da8e tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:16.178760 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-63729101-3630-45b3-a97b-44349fe7da8e tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:16.186596 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-81c4da2d-69b3-444f-8112-39d52e9e354c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:16.187911 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-81c4da2d-69b3-444f-8112-39d52e9e354c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:16.194048 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-81c4da2d-69b3-444f-8112-39d52e9e354c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:16.194498 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-81c4da2d-69b3-444f-8112-39d52e9e354c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:16.195377 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-81c4da2d-69b3-444f-8112-39d52e9e354c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:16.195808 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-81c4da2d-69b3-444f-8112-39d52e9e354c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:16.377768 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-63729101-3630-45b3-a97b-44349fe7da8e tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:16.389888 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-81c4da2d-69b3-444f-8112-39d52e9e354c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:16.394057 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-63729101-3630-45b3-a97b-44349fe7da8e tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1315 microversion: 2.1 time: 0.227470 Aug 03 13:00:16.394638 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 64/121] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:16 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:16.398888 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-81c4da2d-69b3-444f-8112-39d52e9e354c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1322 microversion: 2.1 time: 0.215472 Aug 03 13:00:16.399294 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 58/122] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:16 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:00:16.452477 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-fefc8f47-6f6e-459c-9ab7-7bae91efd896 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:16.453159 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-fefc8f47-6f6e-459c-9ab7-7bae91efd896 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:16.459262 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fefc8f47-6f6e-459c-9ab7-7bae91efd896 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:16.459709 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fefc8f47-6f6e-459c-9ab7-7bae91efd896 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:16.460464 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fefc8f47-6f6e-459c-9ab7-7bae91efd896 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:16.461502 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fefc8f47-6f6e-459c-9ab7-7bae91efd896 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:16.480226 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-9fcebf6b-57be-4dcb-a487-ad7fdecbb2fa tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:16.481067 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-9fcebf6b-57be-4dcb-a487-ad7fdecbb2fa tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:16.487825 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9fcebf6b-57be-4dcb-a487-ad7fdecbb2fa tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:16.494565 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9fcebf6b-57be-4dcb-a487-ad7fdecbb2fa tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:16.494565 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9fcebf6b-57be-4dcb-a487-ad7fdecbb2fa tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:16.494565 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9fcebf6b-57be-4dcb-a487-ad7fdecbb2fa tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:16.665253 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-fefc8f47-6f6e-459c-9ab7-7bae91efd896 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:16.673115 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-fefc8f47-6f6e-459c-9ab7-7bae91efd896 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:16.674717 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-fefc8f47-6f6e-459c-9ab7-7bae91efd896 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:16.675864 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-fefc8f47-6f6e-459c-9ab7-7bae91efd896 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.227461 Aug 03 13:00:16.676414 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 65/123] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:16 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:16.694091 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-9fcebf6b-57be-4dcb-a487-ad7fdecbb2fa tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:16.701889 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-9fcebf6b-57be-4dcb-a487-ad7fdecbb2fa tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1366 microversion: 2.1 time: 0.226866 Aug 03 13:00:16.702449 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 59/124] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:16 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:17.415521 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-840155f7-16c2-4cfb-a5bc-e9631444698b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:17.416729 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-840155f7-16c2-4cfb-a5bc-e9631444698b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:17.423748 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-840155f7-16c2-4cfb-a5bc-e9631444698b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:17.424353 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-840155f7-16c2-4cfb-a5bc-e9631444698b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:17.424809 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-7fdc27b8-0240-43fa-b8c2-b7397b733d42 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:17.425501 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-840155f7-16c2-4cfb-a5bc-e9631444698b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:17.425576 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-7fdc27b8-0240-43fa-b8c2-b7397b733d42 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:17.425813 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-840155f7-16c2-4cfb-a5bc-e9631444698b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:17.432339 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7fdc27b8-0240-43fa-b8c2-b7397b733d42 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:17.432797 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7fdc27b8-0240-43fa-b8c2-b7397b733d42 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:17.437423 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7fdc27b8-0240-43fa-b8c2-b7397b733d42 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:17.437423 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7fdc27b8-0240-43fa-b8c2-b7397b733d42 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:17.641945 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-840155f7-16c2-4cfb-a5bc-e9631444698b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:17.645623 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-7fdc27b8-0240-43fa-b8c2-b7397b733d42 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:17.649940 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-840155f7-16c2-4cfb-a5bc-e9631444698b tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1315 microversion: 2.1 time: 0.239025 Aug 03 13:00:17.650424 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 66/125] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:17 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:17.654242 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-7fdc27b8-0240-43fa-b8c2-b7397b733d42 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1322 microversion: 2.1 time: 0.234253 Aug 03 13:00:17.654824 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 60/126] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:17 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:17.698067 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-159499f3-ac68-463b-8dc2-550eb3f01c04 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:17.698901 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-159499f3-ac68-463b-8dc2-550eb3f01c04 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:17.704916 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-159499f3-ac68-463b-8dc2-550eb3f01c04 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:17.705357 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-159499f3-ac68-463b-8dc2-550eb3f01c04 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:17.706097 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-159499f3-ac68-463b-8dc2-550eb3f01c04 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:17.706521 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-159499f3-ac68-463b-8dc2-550eb3f01c04 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:17.722745 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-837cca51-8c2d-48a2-ad4f-34150c681806 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:17.727358 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-837cca51-8c2d-48a2-ad4f-34150c681806 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:17.729508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-837cca51-8c2d-48a2-ad4f-34150c681806 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:17.729951 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-837cca51-8c2d-48a2-ad4f-34150c681806 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:17.730712 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-837cca51-8c2d-48a2-ad4f-34150c681806 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:17.731195 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-837cca51-8c2d-48a2-ad4f-34150c681806 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:17.918132 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-159499f3-ac68-463b-8dc2-550eb3f01c04 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:17.931504 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-159499f3-ac68-463b-8dc2-550eb3f01c04 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:17.933373 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-159499f3-ac68-463b-8dc2-550eb3f01c04 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:17.934788 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-159499f3-ac68-463b-8dc2-550eb3f01c04 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.241339 Aug 03 13:00:17.947065 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 67/127] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:17 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:17.947810 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-837cca51-8c2d-48a2-ad4f-34150c681806 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:17.959134 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-837cca51-8c2d-48a2-ad4f-34150c681806 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1366 microversion: 2.1 time: 0.239776 Aug 03 13:00:17.959748 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 61/128] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:17 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:18.671771 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-46eef82e-c56e-439e-bc01-bfed75d9dcec tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:18.672453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-46eef82e-c56e-439e-bc01-bfed75d9dcec tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:18.674959 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-cca4d28d-a5e7-4dfc-aad4-a262356cbb83 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:18.675634 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-cca4d28d-a5e7-4dfc-aad4-a262356cbb83 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:18.681893 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-46eef82e-c56e-439e-bc01-bfed75d9dcec tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:18.682346 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-46eef82e-c56e-439e-bc01-bfed75d9dcec tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:18.684180 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-46eef82e-c56e-439e-bc01-bfed75d9dcec tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:18.684631 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-46eef82e-c56e-439e-bc01-bfed75d9dcec tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:18.684989 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cca4d28d-a5e7-4dfc-aad4-a262356cbb83 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:18.685449 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cca4d28d-a5e7-4dfc-aad4-a262356cbb83 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:18.686222 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cca4d28d-a5e7-4dfc-aad4-a262356cbb83 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:18.687021 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cca4d28d-a5e7-4dfc-aad4-a262356cbb83 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:19.036634 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-cca4d28d-a5e7-4dfc-aad4-a262356cbb83 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:19.050234 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-cca4d28d-a5e7-4dfc-aad4-a262356cbb83 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1322 microversion: 2.1 time: 0.379155 Aug 03 13:00:19.066763 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 62/129] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:18 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1322 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:00:19.067246 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-46eef82e-c56e-439e-bc01-bfed75d9dcec tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:19.067385 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-577ef6f0-2a57-48aa-935e-094be7fb40ba tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:19.067480 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-46eef82e-c56e-439e-bc01-bfed75d9dcec tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1315 microversion: 2.1 time: 0.399248 Aug 03 13:00:19.073550 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-577ef6f0-2a57-48aa-935e-094be7fb40ba tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:19.081640 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 68/130] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:18 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:19.090011 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-2e39e80a-bbfb-4d81-af8c-c099564e7f3e tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:19.095220 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-2e39e80a-bbfb-4d81-af8c-c099564e7f3e tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:19.095390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-577ef6f0-2a57-48aa-935e-094be7fb40ba tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:19.097582 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-577ef6f0-2a57-48aa-935e-094be7fb40ba tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:19.099395 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-577ef6f0-2a57-48aa-935e-094be7fb40ba tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:19.100836 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-577ef6f0-2a57-48aa-935e-094be7fb40ba tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:19.108188 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2e39e80a-bbfb-4d81-af8c-c099564e7f3e tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:19.110708 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2e39e80a-bbfb-4d81-af8c-c099564e7f3e tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:19.111646 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2e39e80a-bbfb-4d81-af8c-c099564e7f3e tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:19.112260 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2e39e80a-bbfb-4d81-af8c-c099564e7f3e tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:19.447043 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-577ef6f0-2a57-48aa-935e-094be7fb40ba tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:19.453407 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-577ef6f0-2a57-48aa-935e-094be7fb40ba tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:19.455328 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-577ef6f0-2a57-48aa-935e-094be7fb40ba tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:19.456950 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-577ef6f0-2a57-48aa-935e-094be7fb40ba tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.400103 Aug 03 13:00:19.457762 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 63/131] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:19 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:19.472285 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-aed11180-e201-4126-a5b7-44d6ee143d8a req-8237c7fa-eff1-4078-9446-98f3102ddd55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c576c6-074d-43df-b155-f95b3cd5bb79", "name": "network-vif-plugged", "status": "completed", "tag": "df70904f-7704-4b3b-b5b7-912d817eb793"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:00:19.484755 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-aed11180-e201-4126-a5b7-44d6ee143d8a req-8237c7fa-eff1-4078-9446-98f3102ddd55 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:19.485349 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-aed11180-e201-4126-a5b7-44d6ee143d8a req-8237c7fa-eff1-4078-9446-98f3102ddd55 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:19.498345 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-aed11180-e201-4126-a5b7-44d6ee143d8a req-8237c7fa-eff1-4078-9446-98f3102ddd55 service nova] Creating event network-vif-plugged:df70904f-7704-4b3b-b5b7-912d817eb793 for instance 20c576c6-074d-43df-b155-f95b3cd5bb79 on hv-cinder-85083 Aug 03 13:00:19.507585 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-aed11180-e201-4126-a5b7-44d6ee143d8a req-8237c7fa-eff1-4078-9446-98f3102ddd55 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047790 Aug 03 13:00:19.508990 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 64/132] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:00:19.577671 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-2e39e80a-bbfb-4d81-af8c-c099564e7f3e tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:19.600988 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-2e39e80a-bbfb-4d81-af8c-c099564e7f3e tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1366 microversion: 2.1 time: 0.517260 Aug 03 13:00:19.602931 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 69/133] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:19 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1366 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:20.061827 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-4c31648d-6e89-4d01-8868-67cac7120a2f req-f9d409db-db65-47bc-b708-23789291bce6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8097a062-4988-48d8-b95f-404fdf23d14a", "tag": "c5ff7ffa-b21f-405c-b9b8-d4f1c6b84415"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:00:20.072951 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-4c31648d-6e89-4d01-8868-67cac7120a2f req-f9d409db-db65-47bc-b708-23789291bce6 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:20.074174 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-4c31648d-6e89-4d01-8868-67cac7120a2f req-f9d409db-db65-47bc-b708-23789291bce6 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:20.088762 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-75625976-849c-4c6f-9ed1-ed27f844d9b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:20.089599 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-75625976-849c-4c6f-9ed1-ed27f844d9b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:20.089714 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-4c31648d-6e89-4d01-8868-67cac7120a2f req-f9d409db-db65-47bc-b708-23789291bce6 service nova] Creating event network-changed:c5ff7ffa-b21f-405c-b9b8-d4f1c6b84415 for instance 8097a062-4988-48d8-b95f-404fdf23d14a on hv-cinder-85083 Aug 03 13:00:20.095579 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-4c31648d-6e89-4d01-8868-67cac7120a2f req-f9d409db-db65-47bc-b708-23789291bce6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037722 Aug 03 13:00:20.097229 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 65/134] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:00:20.104701 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-a451d9ec-6ff1-4007-ae74-95431aaf9e73 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:20.105261 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-75625976-849c-4c6f-9ed1-ed27f844d9b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:20.105619 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-75625976-849c-4c6f-9ed1-ed27f844d9b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:20.106142 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-a451d9ec-6ff1-4007-ae74-95431aaf9e73 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:20.108186 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-75625976-849c-4c6f-9ed1-ed27f844d9b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:20.110833 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-75625976-849c-4c6f-9ed1-ed27f844d9b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:20.113968 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a451d9ec-6ff1-4007-ae74-95431aaf9e73 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:20.114680 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a451d9ec-6ff1-4007-ae74-95431aaf9e73 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:20.116632 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a451d9ec-6ff1-4007-ae74-95431aaf9e73 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:20.117256 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a451d9ec-6ff1-4007-ae74-95431aaf9e73 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:20.410912 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-75625976-849c-4c6f-9ed1-ed27f844d9b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:20.418816 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-75625976-849c-4c6f-9ed1-ed27f844d9b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1322 microversion: 2.1 time: 0.342754 Aug 03 13:00:20.419958 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 70/135] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:20 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1322 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:20.424587 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-87bc7442-cf34-4616-b1cf-3d021fd7c083 req-bb317bcc-713d-4f27-ace2-be857843fe5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67e92b94-74d5-4161-ab5d-80b10c84bfb1", "tag": "0950fa19-287f-4d83-950b-1cb1355203d6"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:00:20.434327 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-87bc7442-cf34-4616-b1cf-3d021fd7c083 req-bb317bcc-713d-4f27-ace2-be857843fe5c service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:20.434788 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-87bc7442-cf34-4616-b1cf-3d021fd7c083 req-bb317bcc-713d-4f27-ace2-be857843fe5c service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:20.436707 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-a451d9ec-6ff1-4007-ae74-95431aaf9e73 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:20.448641 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-a451d9ec-6ff1-4007-ae74-95431aaf9e73 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1315 microversion: 2.1 time: 0.349818 Aug 03 13:00:20.449203 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 66/136] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:20 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:20.453548 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-87bc7442-cf34-4616-b1cf-3d021fd7c083 req-bb317bcc-713d-4f27-ace2-be857843fe5c service nova] Creating event network-changed:0950fa19-287f-4d83-950b-1cb1355203d6 for instance 67e92b94-74d5-4161-ab5d-80b10c84bfb1 on hv-cinder-85083 Aug 03 13:00:20.459530 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-87bc7442-cf34-4616-b1cf-3d021fd7c083 req-bb317bcc-713d-4f27-ace2-be857843fe5c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038031 Aug 03 13:00:20.463971 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 71/137] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:00:20.480712 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-625d3da9-d97c-42e4-9787-a447119cbc40 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:20.481355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-625d3da9-d97c-42e4-9787-a447119cbc40 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:20.490021 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-625d3da9-d97c-42e4-9787-a447119cbc40 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:20.490651 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-625d3da9-d97c-42e4-9787-a447119cbc40 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:20.492173 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-625d3da9-d97c-42e4-9787-a447119cbc40 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:20.493114 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-625d3da9-d97c-42e4-9787-a447119cbc40 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:20.630390 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-b2730c80-e066-4a95-8f3b-473036ab7d46 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:20.631732 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-b2730c80-e066-4a95-8f3b-473036ab7d46 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:20.646095 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b2730c80-e066-4a95-8f3b-473036ab7d46 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:20.647061 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b2730c80-e066-4a95-8f3b-473036ab7d46 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:20.648136 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b2730c80-e066-4a95-8f3b-473036ab7d46 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:20.649211 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b2730c80-e066-4a95-8f3b-473036ab7d46 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:20.673958 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=100 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:20.752813 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-625d3da9-d97c-42e4-9787-a447119cbc40 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:20.761948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-625d3da9-d97c-42e4-9787-a447119cbc40 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:20.763499 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-625d3da9-d97c-42e4-9787-a447119cbc40 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:20.764697 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-625d3da9-d97c-42e4-9787-a447119cbc40 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.288539 Aug 03 13:00:20.770136 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 67/138] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:20 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:20.815545 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b2730c80-e066-4a95-8f3b-473036ab7d46 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:20.823822 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-b2730c80-e066-4a95-8f3b-473036ab7d46 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1366 microversion: 2.1 time: 0.203140 Aug 03 13:00:20.824384 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 72/139] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:20 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:00:21.441149 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-7f6983f6-c73d-4080-9be7-bae860d0057d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:21.441791 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-7f6983f6-c73d-4080-9be7-bae860d0057d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:21.456412 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7f6983f6-c73d-4080-9be7-bae860d0057d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:21.456874 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7f6983f6-c73d-4080-9be7-bae860d0057d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:21.457670 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7f6983f6-c73d-4080-9be7-bae860d0057d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:21.458101 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7f6983f6-c73d-4080-9be7-bae860d0057d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:21.472393 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-fcc036d6-45ef-4d86-b80a-c8226606c9c6 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:21.473059 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-fcc036d6-45ef-4d86-b80a-c8226606c9c6 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:21.480289 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fcc036d6-45ef-4d86-b80a-c8226606c9c6 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:21.480996 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fcc036d6-45ef-4d86-b80a-c8226606c9c6 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:21.482136 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fcc036d6-45ef-4d86-b80a-c8226606c9c6 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:21.482574 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fcc036d6-45ef-4d86-b80a-c8226606c9c6 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:21.917174 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-7f6983f6-c73d-4080-9be7-bae860d0057d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:21.924951 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-7f6983f6-c73d-4080-9be7-bae860d0057d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1322 microversion: 2.1 time: 0.487845 Aug 03 13:00:21.925534 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 68/140] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:21 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1322 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:21.933714 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1141be22-dd06-49b0-96e5-4b56959704b2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:21.934368 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-1141be22-dd06-49b0-96e5-4b56959704b2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:21.941589 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1141be22-dd06-49b0-96e5-4b56959704b2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:21.942033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1141be22-dd06-49b0-96e5-4b56959704b2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:21.942813 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1141be22-dd06-49b0-96e5-4b56959704b2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:21.943268 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1141be22-dd06-49b0-96e5-4b56959704b2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:21.981729 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-fcc036d6-45ef-4d86-b80a-c8226606c9c6 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:22.006095 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-fcc036d6-45ef-4d86-b80a-c8226606c9c6 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1315 microversion: 2.1 time: 0.538643 Aug 03 13:00:22.009835 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 73/141] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:21 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1315 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:00:22.029456 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ab3c02af-dad4-4e6f-8e8e-2c0d13501bec tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:22.030297 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-ab3c02af-dad4-4e6f-8e8e-2c0d13501bec tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:22.050476 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ab3c02af-dad4-4e6f-8e8e-2c0d13501bec tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:22.051032 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ab3c02af-dad4-4e6f-8e8e-2c0d13501bec tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:22.052946 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ab3c02af-dad4-4e6f-8e8e-2c0d13501bec tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:22.053393 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ab3c02af-dad4-4e6f-8e8e-2c0d13501bec tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:22.294346 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-1141be22-dd06-49b0-96e5-4b56959704b2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:22.309063 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-1141be22-dd06-49b0-96e5-4b56959704b2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:22.313199 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-1141be22-dd06-49b0-96e5-4b56959704b2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:22.316310 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-1141be22-dd06-49b0-96e5-4b56959704b2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.388317 Aug 03 13:00:22.316683 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ab3c02af-dad4-4e6f-8e8e-2c0d13501bec tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:22.317367 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 69/142] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:21 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:22.340490 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-ab3c02af-dad4-4e6f-8e8e-2c0d13501bec tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1366 microversion: 2.1 time: 0.329199 Aug 03 13:00:22.341215 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 74/143] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:22 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1366 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:22.947307 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1f43aea0-078c-4f69-acc1-22adb584168c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:22.947955 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-1f43aea0-078c-4f69-acc1-22adb584168c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:22.953915 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1f43aea0-078c-4f69-acc1-22adb584168c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:22.954367 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1f43aea0-078c-4f69-acc1-22adb584168c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:22.955200 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1f43aea0-078c-4f69-acc1-22adb584168c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:22.955630 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1f43aea0-078c-4f69-acc1-22adb584168c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:22.960026 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=100 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:23.033262 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-a8409f0d-cb7f-4936-b481-e52501a6bfee tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:23.034513 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-a8409f0d-cb7f-4936-b481-e52501a6bfee tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:23.048703 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a8409f0d-cb7f-4936-b481-e52501a6bfee tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:23.049166 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a8409f0d-cb7f-4936-b481-e52501a6bfee tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:23.050533 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a8409f0d-cb7f-4936-b481-e52501a6bfee tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:23.051540 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a8409f0d-cb7f-4936-b481-e52501a6bfee tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:23.271728 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-1f43aea0-078c-4f69-acc1-22adb584168c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:23.283131 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-1f43aea0-078c-4f69-acc1-22adb584168c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1515 microversion: 2.1 time: 0.341010 Aug 03 13:00:23.284406 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 70/144] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:22 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1515 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:23.305999 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1d8f1db9-67ef-4395-8b18-437a3202fe2e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:00:23.309771 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-1d8f1db9-67ef-4395-8b18-437a3202fe2e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:23.316807 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1d8f1db9-67ef-4395-8b18-437a3202fe2e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:23.317274 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1d8f1db9-67ef-4395-8b18-437a3202fe2e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:23.318453 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1d8f1db9-67ef-4395-8b18-437a3202fe2e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:23.318928 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1d8f1db9-67ef-4395-8b18-437a3202fe2e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:23.396944 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-1d8f1db9-67ef-4395-8b18-437a3202fe2e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lazy-loading 'flavor' on Instance uuid db6cbbae-a113-4148-901c-8509aa6c1ef9 {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:00:23.598430 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-a8409f0d-cb7f-4936-b481-e52501a6bfee tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:23.608946 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-a8409f0d-cb7f-4936-b481-e52501a6bfee tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1315 microversion: 2.1 time: 0.580301 Aug 03 13:00:23.610021 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 75/145] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:23 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1315 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:00:23.620494 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-ac7572a2-e125-4afd-bb5d-a5d6410fec69 req-fcdbc06d-a96f-4137-a039-343eb447ba07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39c466e-0f7f-48d9-accb-da8ecd932142", "name": "network-vif-plugged", "status": "completed", "tag": "bb8defef-013e-4d49-8621-5b924722dedc"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:00:23.631396 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-ac7572a2-e125-4afd-bb5d-a5d6410fec69 req-fcdbc06d-a96f-4137-a039-343eb447ba07 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:23.631973 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-ac7572a2-e125-4afd-bb5d-a5d6410fec69 req-fcdbc06d-a96f-4137-a039-343eb447ba07 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:23.644970 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-ac7572a2-e125-4afd-bb5d-a5d6410fec69 req-fcdbc06d-a96f-4137-a039-343eb447ba07 service nova] Creating event network-vif-plugged:bb8defef-013e-4d49-8621-5b924722dedc for instance b39c466e-0f7f-48d9-accb-da8ecd932142 on hv-cinder-85083 Aug 03 13:00:23.650059 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-ac7572a2-e125-4afd-bb5d-a5d6410fec69 req-fcdbc06d-a96f-4137-a039-343eb447ba07 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038856 Aug 03 13:00:23.650756 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 76/146] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:00:23.660449 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-4663f54c-47dc-488e-ae09-f6eb802aa95c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:23.661369 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-4663f54c-47dc-488e-ae09-f6eb802aa95c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:23.669169 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4663f54c-47dc-488e-ae09-f6eb802aa95c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:23.669673 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4663f54c-47dc-488e-ae09-f6eb802aa95c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:23.670570 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4663f54c-47dc-488e-ae09-f6eb802aa95c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:23.671097 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4663f54c-47dc-488e-ae09-f6eb802aa95c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:23.839161 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-1d8f1db9-67ef-4395-8b18-437a3202fe2e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "POST /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9/action" status: 200 len: 32 microversion: 2.1 time: 0.538395 Aug 03 13:00:23.844678 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 71/147] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Aug 3 13:00:23 2022] POST /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9/action => generated 32 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 13:00:23.850173 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-c97829f5-3dff-4534-a66e-b6e17c2d3883 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:23.852480 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-c97829f5-3dff-4534-a66e-b6e17c2d3883 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:23.859800 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c97829f5-3dff-4534-a66e-b6e17c2d3883 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:23.860253 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c97829f5-3dff-4534-a66e-b6e17c2d3883 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:23.861069 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c97829f5-3dff-4534-a66e-b6e17c2d3883 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:23.861506 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c97829f5-3dff-4534-a66e-b6e17c2d3883 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:23.983878 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-4663f54c-47dc-488e-ae09-f6eb802aa95c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:23.994323 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-4663f54c-47dc-488e-ae09-f6eb802aa95c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:23.995892 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-4663f54c-47dc-488e-ae09-f6eb802aa95c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:23.997506 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-4663f54c-47dc-488e-ae09-f6eb802aa95c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.341957 Aug 03 13:00:24.012383 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 77/148] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:23 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:24.019094 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-b1e701ca-23be-4dce-8376-4b9ed7f7b523 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:24.019917 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-b1e701ca-23be-4dce-8376-4b9ed7f7b523 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:24.023983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=100 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:24.028491 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b1e701ca-23be-4dce-8376-4b9ed7f7b523 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:24.028932 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b1e701ca-23be-4dce-8376-4b9ed7f7b523 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:24.029692 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b1e701ca-23be-4dce-8376-4b9ed7f7b523 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:24.030209 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b1e701ca-23be-4dce-8376-4b9ed7f7b523 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:24.398037 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c97829f5-3dff-4534-a66e-b6e17c2d3883 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:24.419229 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-c97829f5-3dff-4534-a66e-b6e17c2d3883 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1366 microversion: 2.1 time: 0.574563 Aug 03 13:00:24.423396 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 72/149] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:23 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1366 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:24.424934 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b1e701ca-23be-4dce-8376-4b9ed7f7b523 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:24.436906 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-b1e701ca-23be-4dce-8376-4b9ed7f7b523 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.422428 Aug 03 13:00:24.437567 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 78/150] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:24 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:24.632176 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-c4c6bebc-3453-4889-bcfb-40e1eea1cda7 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:24.632790 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-c4c6bebc-3453-4889-bcfb-40e1eea1cda7 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:24.639213 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c4c6bebc-3453-4889-bcfb-40e1eea1cda7 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:24.639919 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c4c6bebc-3453-4889-bcfb-40e1eea1cda7 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:24.641038 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c4c6bebc-3453-4889-bcfb-40e1eea1cda7 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:24.642276 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c4c6bebc-3453-4889-bcfb-40e1eea1cda7 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:24.785271 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c4c6bebc-3453-4889-bcfb-40e1eea1cda7 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:24.794390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-c4c6bebc-3453-4889-bcfb-40e1eea1cda7 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1502 microversion: 2.1 time: 0.166270 Aug 03 13:00:24.794990 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 73/151] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:24 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1502 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:25.021798 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-3532e219-2d88-49dc-84c9-c3dae3c0e3bd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:25.022585 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-3532e219-2d88-49dc-84c9-c3dae3c0e3bd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:25.032706 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3532e219-2d88-49dc-84c9-c3dae3c0e3bd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:25.033682 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3532e219-2d88-49dc-84c9-c3dae3c0e3bd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:25.034853 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3532e219-2d88-49dc-84c9-c3dae3c0e3bd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:25.040016 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3532e219-2d88-49dc-84c9-c3dae3c0e3bd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:25.211664 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-3532e219-2d88-49dc-84c9-c3dae3c0e3bd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:25.222252 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-3532e219-2d88-49dc-84c9-c3dae3c0e3bd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:25.223785 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-3532e219-2d88-49dc-84c9-c3dae3c0e3bd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:25.224915 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-3532e219-2d88-49dc-84c9-c3dae3c0e3bd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.207742 Aug 03 13:00:25.225472 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 79/152] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:25 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:25.452246 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-4a0b59b1-2e44-4174-8701-4878b068e719 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:25.452866 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-4a0b59b1-2e44-4174-8701-4878b068e719 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:25.458447 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-57a80922-1eb7-4497-a525-c8fac35f4bab tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:25.459188 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-57a80922-1eb7-4497-a525-c8fac35f4bab tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:25.459317 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4a0b59b1-2e44-4174-8701-4878b068e719 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:25.459688 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4a0b59b1-2e44-4174-8701-4878b068e719 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:25.460473 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4a0b59b1-2e44-4174-8701-4878b068e719 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:25.460900 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4a0b59b1-2e44-4174-8701-4878b068e719 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:25.465300 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-57a80922-1eb7-4497-a525-c8fac35f4bab tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:25.469862 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-57a80922-1eb7-4497-a525-c8fac35f4bab tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:25.469862 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-57a80922-1eb7-4497-a525-c8fac35f4bab tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:25.469862 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-57a80922-1eb7-4497-a525-c8fac35f4bab tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:25.706197 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-4a0b59b1-2e44-4174-8701-4878b068e719 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:25.715306 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-4a0b59b1-2e44-4174-8701-4878b068e719 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1366 microversion: 2.1 time: 0.267346 Aug 03 13:00:25.729881 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 74/153] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:25 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:25.816291 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-57a80922-1eb7-4497-a525-c8fac35f4bab tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:25.824893 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-57a80922-1eb7-4497-a525-c8fac35f4bab tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.370245 Aug 03 13:00:25.843061 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 80/154] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:25 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:00:26.253872 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e99124a6-4125-4963-b12c-7cf785a48112 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:26.254480 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-e99124a6-4125-4963-b12c-7cf785a48112 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:26.283174 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e99124a6-4125-4963-b12c-7cf785a48112 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:26.283174 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e99124a6-4125-4963-b12c-7cf785a48112 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:26.283174 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e99124a6-4125-4963-b12c-7cf785a48112 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:26.283174 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e99124a6-4125-4963-b12c-7cf785a48112 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:26.412369 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-e99124a6-4125-4963-b12c-7cf785a48112 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:26.420518 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-e99124a6-4125-4963-b12c-7cf785a48112 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:26.422028 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-e99124a6-4125-4963-b12c-7cf785a48112 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:26.427795 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-e99124a6-4125-4963-b12c-7cf785a48112 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.173062 Aug 03 13:00:26.427795 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 75/155] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:26 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:26.742203 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d9bf3b88-96e3-4b8c-b001-6bdce06d0dde tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:26.743326 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-d9bf3b88-96e3-4b8c-b001-6bdce06d0dde tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:26.750671 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d9bf3b88-96e3-4b8c-b001-6bdce06d0dde tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:26.751232 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d9bf3b88-96e3-4b8c-b001-6bdce06d0dde tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:26.751915 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d9bf3b88-96e3-4b8c-b001-6bdce06d0dde tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:26.752556 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d9bf3b88-96e3-4b8c-b001-6bdce06d0dde tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:26.847510 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-3a6290ea-0841-4081-8ad7-0a279d2656b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:26.853518 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-3a6290ea-0841-4081-8ad7-0a279d2656b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:26.860089 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3a6290ea-0841-4081-8ad7-0a279d2656b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:26.860634 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3a6290ea-0841-4081-8ad7-0a279d2656b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:26.861457 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3a6290ea-0841-4081-8ad7-0a279d2656b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:26.864075 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3a6290ea-0841-4081-8ad7-0a279d2656b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:26.929574 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-d9bf3b88-96e3-4b8c-b001-6bdce06d0dde tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:26.944339 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-d9bf3b88-96e3-4b8c-b001-6bdce06d0dde tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1366 microversion: 2.1 time: 0.209599 Aug 03 13:00:26.957972 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 81/156] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:26 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:27.192713 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-3a6290ea-0841-4081-8ad7-0a279d2656b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:27.203390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-3a6290ea-0841-4081-8ad7-0a279d2656b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.359864 Aug 03 13:00:27.204716 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 76/157] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:26 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:27.445283 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-591ac616-f660-41f8-9ff9-aa5e98f583e6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:27.446012 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-591ac616-f660-41f8-9ff9-aa5e98f583e6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:27.452461 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-591ac616-f660-41f8-9ff9-aa5e98f583e6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:27.453784 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-591ac616-f660-41f8-9ff9-aa5e98f583e6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:27.454766 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-591ac616-f660-41f8-9ff9-aa5e98f583e6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:27.455360 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-591ac616-f660-41f8-9ff9-aa5e98f583e6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:27.603994 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-591ac616-f660-41f8-9ff9-aa5e98f583e6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:27.613183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-591ac616-f660-41f8-9ff9-aa5e98f583e6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:27.614911 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-591ac616-f660-41f8-9ff9-aa5e98f583e6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:27.616341 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-591ac616-f660-41f8-9ff9-aa5e98f583e6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.174779 Aug 03 13:00:27.616898 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 82/158] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:27 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:27.716247 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-401e9444-f12f-4978-a0bd-abed0d317166 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb9df396-1205-4787-ba80-a5defb71fddd"}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:00:27.718633 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-401e9444-f12f-4978-a0bd-abed0d317166 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:27.724806 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-401e9444-f12f-4978-a0bd-abed0d317166 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:27.725258 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-401e9444-f12f-4978-a0bd-abed0d317166 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:27.726060 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-401e9444-f12f-4978-a0bd-abed0d317166 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:27.726492 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-401e9444-f12f-4978-a0bd-abed0d317166 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:27.966124 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-9d695100-d5f6-4428-a712-c4d993f5813d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:27.966781 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-9d695100-d5f6-4428-a712-c4d993f5813d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:27.973017 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9d695100-d5f6-4428-a712-c4d993f5813d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:27.973459 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9d695100-d5f6-4428-a712-c4d993f5813d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:27.974225 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9d695100-d5f6-4428-a712-c4d993f5813d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:27.974656 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9d695100-d5f6-4428-a712-c4d993f5813d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:28.204471 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-9d695100-d5f6-4428-a712-c4d993f5813d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:28.216261 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-9d695100-d5f6-4428-a712-c4d993f5813d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1366 microversion: 2.1 time: 0.251921 Aug 03 13:00:28.216873 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 83/159] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:27 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:28.230455 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-fb607754-4bf3-4f7e-856e-20fc12dccd99 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:28.231138 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-fb607754-4bf3-4f7e-856e-20fc12dccd99 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:28.239222 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fb607754-4bf3-4f7e-856e-20fc12dccd99 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:28.239979 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fb607754-4bf3-4f7e-856e-20fc12dccd99 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:28.240817 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fb607754-4bf3-4f7e-856e-20fc12dccd99 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:28.241276 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fb607754-4bf3-4f7e-856e-20fc12dccd99 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:28.381634 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-fb607754-4bf3-4f7e-856e-20fc12dccd99 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:28.390097 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-fb607754-4bf3-4f7e-856e-20fc12dccd99 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.168509 Aug 03 13:00:28.391045 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 84/160] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:28 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:28.641466 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-bae7baed-b80c-4291-8f80-dab839c503ad tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:28.642357 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-bae7baed-b80c-4291-8f80-dab839c503ad tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:28.650241 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bae7baed-b80c-4291-8f80-dab839c503ad tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:28.651352 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bae7baed-b80c-4291-8f80-dab839c503ad tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:28.652138 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bae7baed-b80c-4291-8f80-dab839c503ad tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:28.652708 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bae7baed-b80c-4291-8f80-dab839c503ad tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:28.791330 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-bae7baed-b80c-4291-8f80-dab839c503ad tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:28.799444 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-bae7baed-b80c-4291-8f80-dab839c503ad tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:28.800751 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-bae7baed-b80c-4291-8f80-dab839c503ad tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:28.801852 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-bae7baed-b80c-4291-8f80-dab839c503ad tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.164892 Aug 03 13:00:28.802403 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 85/161] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:28 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:29.239523 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-3656f287-0280-422d-a285-e27ece14b199 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:29.240164 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-3656f287-0280-422d-a285-e27ece14b199 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:29.246377 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3656f287-0280-422d-a285-e27ece14b199 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:29.246941 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3656f287-0280-422d-a285-e27ece14b199 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:29.247770 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3656f287-0280-422d-a285-e27ece14b199 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:29.248293 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3656f287-0280-422d-a285-e27ece14b199 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:29.466548 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-3656f287-0280-422d-a285-e27ece14b199 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:29.475674 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-3656f287-0280-422d-a285-e27ece14b199 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1366 microversion: 2.1 time: 0.239566 Aug 03 13:00:29.476757 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 86/162] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:29 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:00:29.481159 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d431966a-ee82-45fd-a083-630b7a90c1e5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:29.481968 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-d431966a-ee82-45fd-a083-630b7a90c1e5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:29.487853 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d431966a-ee82-45fd-a083-630b7a90c1e5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:29.494008 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d431966a-ee82-45fd-a083-630b7a90c1e5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:29.494008 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d431966a-ee82-45fd-a083-630b7a90c1e5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:29.494008 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d431966a-ee82-45fd-a083-630b7a90c1e5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:29.624478 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-d431966a-ee82-45fd-a083-630b7a90c1e5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:29.633485 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-d431966a-ee82-45fd-a083-630b7a90c1e5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.155837 Aug 03 13:00:29.647990 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 87/163] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:29 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:29.826577 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-3cc6e8a6-8a93-4060-a4a7-8f208dc60191 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:29.827220 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-3cc6e8a6-8a93-4060-a4a7-8f208dc60191 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:29.833481 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3cc6e8a6-8a93-4060-a4a7-8f208dc60191 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:29.833929 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3cc6e8a6-8a93-4060-a4a7-8f208dc60191 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:29.834684 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3cc6e8a6-8a93-4060-a4a7-8f208dc60191 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:29.835177 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3cc6e8a6-8a93-4060-a4a7-8f208dc60191 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:30.265680 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-3cc6e8a6-8a93-4060-a4a7-8f208dc60191 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:30.274019 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-3cc6e8a6-8a93-4060-a4a7-8f208dc60191 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:30.278005 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-3cc6e8a6-8a93-4060-a4a7-8f208dc60191 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:30.282922 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-3cc6e8a6-8a93-4060-a4a7-8f208dc60191 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.460152 Aug 03 13:00:30.286008 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 88/164] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:29 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:30.497789 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-523eb3fe-e077-484e-80ff-90141fa4059a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:30.497789 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-523eb3fe-e077-484e-80ff-90141fa4059a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:30.503682 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-523eb3fe-e077-484e-80ff-90141fa4059a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:30.504128 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-523eb3fe-e077-484e-80ff-90141fa4059a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:30.504969 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-523eb3fe-e077-484e-80ff-90141fa4059a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:30.505408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-523eb3fe-e077-484e-80ff-90141fa4059a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:30.648366 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-523eb3fe-e077-484e-80ff-90141fa4059a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:30.652246 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=100 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:30.657358 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-523eb3fe-e077-484e-80ff-90141fa4059a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1366 microversion: 2.1 time: 0.164020 Aug 03 13:00:30.671214 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 89/165] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:30 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:00:30.677703 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-dbb24dab-f6da-4ed6-b848-596dce45a76f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:30.678428 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-dbb24dab-f6da-4ed6-b848-596dce45a76f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:30.685356 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-dbb24dab-f6da-4ed6-b848-596dce45a76f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:30.685918 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-dbb24dab-f6da-4ed6-b848-596dce45a76f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:30.686898 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-dbb24dab-f6da-4ed6-b848-596dce45a76f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:30.687425 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-dbb24dab-f6da-4ed6-b848-596dce45a76f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:30.821944 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-dbb24dab-f6da-4ed6-b848-596dce45a76f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:30.830368 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-dbb24dab-f6da-4ed6-b848-596dce45a76f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.157995 Aug 03 13:00:30.831671 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 90/166] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:30 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:31.307060 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-5ac9537e-c213-4453-8371-b6bba4a487bd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:31.307761 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-5ac9537e-c213-4453-8371-b6bba4a487bd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:31.314491 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5ac9537e-c213-4453-8371-b6bba4a487bd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:31.314972 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5ac9537e-c213-4453-8371-b6bba4a487bd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:31.315739 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5ac9537e-c213-4453-8371-b6bba4a487bd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:31.316173 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5ac9537e-c213-4453-8371-b6bba4a487bd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:31.473298 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-5ac9537e-c213-4453-8371-b6bba4a487bd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:31.481619 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-5ac9537e-c213-4453-8371-b6bba4a487bd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:31.483381 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-5ac9537e-c213-4453-8371-b6bba4a487bd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:31.484944 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-5ac9537e-c213-4453-8371-b6bba4a487bd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.181525 Aug 03 13:00:31.486215 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 91/167] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:31 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:31.491179 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-cc98da8a-3470-4284-9c53-d9571858b194 req-3e54fc7e-aa9a-438b-a27f-da519ed9ada6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8097a062-4988-48d8-b95f-404fdf23d14a", "name": "network-vif-plugged", "status": "completed", "tag": "c5ff7ffa-b21f-405c-b9b8-d4f1c6b84415"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:00:31.502827 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-cc98da8a-3470-4284-9c53-d9571858b194 req-3e54fc7e-aa9a-438b-a27f-da519ed9ada6 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:31.503439 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-cc98da8a-3470-4284-9c53-d9571858b194 req-3e54fc7e-aa9a-438b-a27f-da519ed9ada6 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:31.516282 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-cc98da8a-3470-4284-9c53-d9571858b194 req-3e54fc7e-aa9a-438b-a27f-da519ed9ada6 service nova] Creating event network-vif-plugged:c5ff7ffa-b21f-405c-b9b8-d4f1c6b84415 for instance 8097a062-4988-48d8-b95f-404fdf23d14a on hv-cinder-85083 Aug 03 13:00:31.551996 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-cc98da8a-3470-4284-9c53-d9571858b194 req-3e54fc7e-aa9a-438b-a27f-da519ed9ada6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056850 Aug 03 13:00:31.551996 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 92/168] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:00:31.705876 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-83d9eee5-d241-497b-b513-ece10d699ffb tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:31.706581 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-83d9eee5-d241-497b-b513-ece10d699ffb tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:31.730226 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-83d9eee5-d241-497b-b513-ece10d699ffb tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:31.730672 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-83d9eee5-d241-497b-b513-ece10d699ffb tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:31.731664 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-83d9eee5-d241-497b-b513-ece10d699ffb tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:31.732070 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-83d9eee5-d241-497b-b513-ece10d699ffb tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:31.896402 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-83d9eee5-d241-497b-b513-ece10d699ffb tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:31.904940 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-83d9eee5-d241-497b-b513-ece10d699ffb tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1366 microversion: 2.1 time: 0.223940 Aug 03 13:00:31.905508 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 93/169] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:31 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:00:31.910393 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-040d1f56-989b-4105-a034-c6dc43e1921c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:31.911051 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-040d1f56-989b-4105-a034-c6dc43e1921c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:31.916939 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-040d1f56-989b-4105-a034-c6dc43e1921c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:31.917391 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-040d1f56-989b-4105-a034-c6dc43e1921c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:31.918250 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-040d1f56-989b-4105-a034-c6dc43e1921c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:31.918808 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-040d1f56-989b-4105-a034-c6dc43e1921c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:32.068571 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-040d1f56-989b-4105-a034-c6dc43e1921c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:32.078952 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-040d1f56-989b-4105-a034-c6dc43e1921c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.172218 Aug 03 13:00:32.079526 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 94/170] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:31 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:32.485939 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-401e9444-f12f-4978-a0bd-abed0d317166 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "POST /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.771814 Aug 03 13:00:32.493615 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 77/171] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Aug 3 13:00:27 2022] POST /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79/os-volume_attachments => generated 194 bytes in 4782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:00:32.508495 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-a874c6e9-34eb-4403-8e4b-f96ad8022f11 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:32.509668 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-a874c6e9-34eb-4403-8e4b-f96ad8022f11 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:32.516870 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a874c6e9-34eb-4403-8e4b-f96ad8022f11 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:32.517276 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a874c6e9-34eb-4403-8e4b-f96ad8022f11 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:32.518016 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a874c6e9-34eb-4403-8e4b-f96ad8022f11 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:32.518619 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a874c6e9-34eb-4403-8e4b-f96ad8022f11 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:32.675791 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-a874c6e9-34eb-4403-8e4b-f96ad8022f11 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:32.686997 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-a874c6e9-34eb-4403-8e4b-f96ad8022f11 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:32.688873 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-a874c6e9-34eb-4403-8e4b-f96ad8022f11 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:32.690415 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-a874c6e9-34eb-4403-8e4b-f96ad8022f11 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.186193 Aug 03 13:00:32.691535 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 95/172] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:32 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:32.927055 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e1170feb-22a3-42e7-968e-bfcdf80478dc tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:32.927778 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-e1170feb-22a3-42e7-968e-bfcdf80478dc tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:32.934587 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e1170feb-22a3-42e7-968e-bfcdf80478dc tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:32.935071 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e1170feb-22a3-42e7-968e-bfcdf80478dc tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:32.935834 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e1170feb-22a3-42e7-968e-bfcdf80478dc tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:32.936272 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e1170feb-22a3-42e7-968e-bfcdf80478dc tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:33.073927 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-e1170feb-22a3-42e7-968e-bfcdf80478dc tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:33.081685 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-e1170feb-22a3-42e7-968e-bfcdf80478dc tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1366 microversion: 2.1 time: 0.158760 Aug 03 13:00:33.082250 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 78/173] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:32 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:33.099850 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-0adde2b8-2a9d-451b-9f06-2355338a65c4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:33.100407 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-0adde2b8-2a9d-451b-9f06-2355338a65c4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:33.106482 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0adde2b8-2a9d-451b-9f06-2355338a65c4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:33.106967 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0adde2b8-2a9d-451b-9f06-2355338a65c4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:33.107716 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0adde2b8-2a9d-451b-9f06-2355338a65c4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:33.108139 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0adde2b8-2a9d-451b-9f06-2355338a65c4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:33.248596 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-0adde2b8-2a9d-451b-9f06-2355338a65c4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:33.257694 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-0adde2b8-2a9d-451b-9f06-2355338a65c4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.161062 Aug 03 13:00:33.258629 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 96/174] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:33 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:00:33.713270 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-ced8bde6-5958-44a6-836d-cb9d3b26eb41 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:33.713977 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-ced8bde6-5958-44a6-836d-cb9d3b26eb41 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:33.720287 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ced8bde6-5958-44a6-836d-cb9d3b26eb41 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:33.720816 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ced8bde6-5958-44a6-836d-cb9d3b26eb41 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:33.721692 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ced8bde6-5958-44a6-836d-cb9d3b26eb41 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:33.722195 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ced8bde6-5958-44a6-836d-cb9d3b26eb41 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:33.856419 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ced8bde6-5958-44a6-836d-cb9d3b26eb41 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:33.867753 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ced8bde6-5958-44a6-836d-cb9d3b26eb41 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:33.867753 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ced8bde6-5958-44a6-836d-cb9d3b26eb41 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:33.867753 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-ced8bde6-5958-44a6-836d-cb9d3b26eb41 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.158550 Aug 03 13:00:33.868229 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 79/175] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:33 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:34.103344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-bcbe8f8a-b40b-4c40-91ee-44334d06d816 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:34.103955 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-bcbe8f8a-b40b-4c40-91ee-44334d06d816 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:34.110089 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bcbe8f8a-b40b-4c40-91ee-44334d06d816 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:34.110534 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bcbe8f8a-b40b-4c40-91ee-44334d06d816 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:34.111327 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bcbe8f8a-b40b-4c40-91ee-44334d06d816 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:34.111763 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bcbe8f8a-b40b-4c40-91ee-44334d06d816 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:34.243441 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-bcbe8f8a-b40b-4c40-91ee-44334d06d816 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:34.252060 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-bcbe8f8a-b40b-4c40-91ee-44334d06d816 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1366 microversion: 2.1 time: 0.153117 Aug 03 13:00:34.252622 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 97/176] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:34 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:34.280497 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-19c54f78-522f-4fb4-a2f2-b66e770172ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:34.281109 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-19c54f78-522f-4fb4-a2f2-b66e770172ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:34.288591 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-19c54f78-522f-4fb4-a2f2-b66e770172ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:34.289030 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-19c54f78-522f-4fb4-a2f2-b66e770172ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:34.289767 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-19c54f78-522f-4fb4-a2f2-b66e770172ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:34.290215 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-19c54f78-522f-4fb4-a2f2-b66e770172ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:34.422406 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-19c54f78-522f-4fb4-a2f2-b66e770172ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:34.431940 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-19c54f78-522f-4fb4-a2f2-b66e770172ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.155997 Aug 03 13:00:34.432705 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 80/177] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:34 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:34.890094 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d917eff6-7fe2-4c28-a5e6-5f947cad2f4b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:34.890930 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-d917eff6-7fe2-4c28-a5e6-5f947cad2f4b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:34.896881 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d917eff6-7fe2-4c28-a5e6-5f947cad2f4b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:34.897379 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d917eff6-7fe2-4c28-a5e6-5f947cad2f4b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:34.898107 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d917eff6-7fe2-4c28-a5e6-5f947cad2f4b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:34.898533 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d917eff6-7fe2-4c28-a5e6-5f947cad2f4b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:35.097521 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-d917eff6-7fe2-4c28-a5e6-5f947cad2f4b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:35.126818 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-d917eff6-7fe2-4c28-a5e6-5f947cad2f4b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:35.128334 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-d917eff6-7fe2-4c28-a5e6-5f947cad2f4b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:35.129445 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-d917eff6-7fe2-4c28-a5e6-5f947cad2f4b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.243453 Aug 03 13:00:35.129989 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 98/178] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:34 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:35.274023 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e705bf8f-1a6b-475d-95e2-2a5aee73edce tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:35.279896 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-e705bf8f-1a6b-475d-95e2-2a5aee73edce tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:35.279896 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=92 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:35.291695 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e705bf8f-1a6b-475d-95e2-2a5aee73edce tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:35.292273 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e705bf8f-1a6b-475d-95e2-2a5aee73edce tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:35.293057 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e705bf8f-1a6b-475d-95e2-2a5aee73edce tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:35.293493 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e705bf8f-1a6b-475d-95e2-2a5aee73edce tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:35.428533 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-e705bf8f-1a6b-475d-95e2-2a5aee73edce tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:35.435976 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-e705bf8f-1a6b-475d-95e2-2a5aee73edce tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1366 microversion: 2.1 time: 0.166883 Aug 03 13:00:35.436581 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 81/179] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:35 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:35.453396 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-5eaf19af-8fd9-4540-95cc-963febc06e9f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:35.454004 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-5eaf19af-8fd9-4540-95cc-963febc06e9f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:35.460606 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5eaf19af-8fd9-4540-95cc-963febc06e9f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:35.461050 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5eaf19af-8fd9-4540-95cc-963febc06e9f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:35.461841 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5eaf19af-8fd9-4540-95cc-963febc06e9f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:35.462270 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5eaf19af-8fd9-4540-95cc-963febc06e9f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:35.594826 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-5eaf19af-8fd9-4540-95cc-963febc06e9f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:35.602300 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-5eaf19af-8fd9-4540-95cc-963febc06e9f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.152725 Aug 03 13:00:35.602885 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 99/180] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:35 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:00:36.153389 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-a50ad78a-367b-4975-8510-f397216bdfc2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:36.154222 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-a50ad78a-367b-4975-8510-f397216bdfc2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:36.163283 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a50ad78a-367b-4975-8510-f397216bdfc2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:36.163745 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a50ad78a-367b-4975-8510-f397216bdfc2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:36.164528 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a50ad78a-367b-4975-8510-f397216bdfc2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:36.165031 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a50ad78a-367b-4975-8510-f397216bdfc2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:36.344584 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-a50ad78a-367b-4975-8510-f397216bdfc2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:36.345513 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-a50ad78a-367b-4975-8510-f397216bdfc2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:36.347078 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-a50ad78a-367b-4975-8510-f397216bdfc2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:36.348179 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-a50ad78a-367b-4975-8510-f397216bdfc2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.199472 Aug 03 13:00:36.348802 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 82/181] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:36 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:00:36.457283 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-14fe2f63-5163-4109-ad72-5cafb6cca491 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:36.457888 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-14fe2f63-5163-4109-ad72-5cafb6cca491 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:36.464436 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-14fe2f63-5163-4109-ad72-5cafb6cca491 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:36.464907 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-14fe2f63-5163-4109-ad72-5cafb6cca491 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:36.465660 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-14fe2f63-5163-4109-ad72-5cafb6cca491 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:36.466089 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-14fe2f63-5163-4109-ad72-5cafb6cca491 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:36.607318 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-14fe2f63-5163-4109-ad72-5cafb6cca491 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:36.615092 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-14fe2f63-5163-4109-ad72-5cafb6cca491 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1366 microversion: 2.1 time: 0.161162 Aug 03 13:00:36.615799 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 100/182] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:36 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:36.629220 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-99dc9a4c-9d67-4694-b091-dad27d46e189 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:36.630173 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-99dc9a4c-9d67-4694-b091-dad27d46e189 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:36.638660 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-99dc9a4c-9d67-4694-b091-dad27d46e189 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:36.639278 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-99dc9a4c-9d67-4694-b091-dad27d46e189 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:36.640133 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-99dc9a4c-9d67-4694-b091-dad27d46e189 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:36.640538 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-99dc9a4c-9d67-4694-b091-dad27d46e189 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:36.656749 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:36.773689 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-99dc9a4c-9d67-4694-b091-dad27d46e189 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:36.782020 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-99dc9a4c-9d67-4694-b091-dad27d46e189 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.159309 Aug 03 13:00:36.782571 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 83/183] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:36 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:00:37.371424 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-18d69b1e-063f-47c3-8065-738b801f4b35 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:37.372280 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-18d69b1e-063f-47c3-8065-738b801f4b35 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:37.380309 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-18d69b1e-063f-47c3-8065-738b801f4b35 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:37.380309 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-18d69b1e-063f-47c3-8065-738b801f4b35 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:37.380309 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-18d69b1e-063f-47c3-8065-738b801f4b35 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:37.380776 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-18d69b1e-063f-47c3-8065-738b801f4b35 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:37.524049 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-18d69b1e-063f-47c3-8065-738b801f4b35 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:37.532043 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-18d69b1e-063f-47c3-8065-738b801f4b35 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:37.533525 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-18d69b1e-063f-47c3-8065-738b801f4b35 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:37.534598 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-18d69b1e-063f-47c3-8065-738b801f4b35 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.167157 Aug 03 13:00:37.535180 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 101/184] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:37 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:37.635696 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e755951a-1580-4ef2-98fa-f9b90f2bc0ab tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:37.636411 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-e755951a-1580-4ef2-98fa-f9b90f2bc0ab tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:37.643311 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e755951a-1580-4ef2-98fa-f9b90f2bc0ab tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:37.650223 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e755951a-1580-4ef2-98fa-f9b90f2bc0ab tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:37.650223 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e755951a-1580-4ef2-98fa-f9b90f2bc0ab tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:37.650223 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e755951a-1580-4ef2-98fa-f9b90f2bc0ab tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:37.781112 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-e755951a-1580-4ef2-98fa-f9b90f2bc0ab tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:37.789085 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-e755951a-1580-4ef2-98fa-f9b90f2bc0ab tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1366 microversion: 2.1 time: 0.158047 Aug 03 13:00:37.789746 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 84/185] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:37 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:37.802940 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-7757cd10-8367-4526-b324-68052817b059 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:37.804153 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-7757cd10-8367-4526-b324-68052817b059 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:37.810190 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7757cd10-8367-4526-b324-68052817b059 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:37.814594 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7757cd10-8367-4526-b324-68052817b059 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:37.814594 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7757cd10-8367-4526-b324-68052817b059 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:37.814594 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7757cd10-8367-4526-b324-68052817b059 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:37.959739 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-7757cd10-8367-4526-b324-68052817b059 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:37.965671 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-7757cd10-8367-4526-b324-68052817b059 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.166298 Aug 03 13:00:37.966310 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 102/186] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:37 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:38.557673 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d4fab19f-5d5b-45c6-bdc4-a2a1d119a9cb tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:38.558364 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d4fab19f-5d5b-45c6-bdc4-a2a1d119a9cb tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:38.564823 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d4fab19f-5d5b-45c6-bdc4-a2a1d119a9cb tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:38.567578 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d4fab19f-5d5b-45c6-bdc4-a2a1d119a9cb tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:38.567578 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d4fab19f-5d5b-45c6-bdc4-a2a1d119a9cb tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:38.567578 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d4fab19f-5d5b-45c6-bdc4-a2a1d119a9cb tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:38.714846 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d4fab19f-5d5b-45c6-bdc4-a2a1d119a9cb tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:38.723310 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d4fab19f-5d5b-45c6-bdc4-a2a1d119a9cb tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:38.724818 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d4fab19f-5d5b-45c6-bdc4-a2a1d119a9cb tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:38.726484 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d4fab19f-5d5b-45c6-bdc4-a2a1d119a9cb tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.173729 Aug 03 13:00:38.727160 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 85/187] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:38 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:38.809814 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-7f159875-4270-4dac-ab25-5c8c11c66111 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:38.810479 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-7f159875-4270-4dac-ab25-5c8c11c66111 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:38.816567 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7f159875-4270-4dac-ab25-5c8c11c66111 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:38.817010 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7f159875-4270-4dac-ab25-5c8c11c66111 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:38.817768 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7f159875-4270-4dac-ab25-5c8c11c66111 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:38.818201 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7f159875-4270-4dac-ab25-5c8c11c66111 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:38.969561 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-7f159875-4270-4dac-ab25-5c8c11c66111 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:38.976870 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-7f159875-4270-4dac-ab25-5c8c11c66111 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1366 microversion: 2.1 time: 0.171049 Aug 03 13:00:38.977419 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 103/188] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:38 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:38.986477 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-4d90d405-20a2-4f11-97eb-701d9167c57d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:38.989496 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-4d90d405-20a2-4f11-97eb-701d9167c57d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:38.993261 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4d90d405-20a2-4f11-97eb-701d9167c57d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:38.993710 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4d90d405-20a2-4f11-97eb-701d9167c57d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:38.994462 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4d90d405-20a2-4f11-97eb-701d9167c57d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:38.994930 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4d90d405-20a2-4f11-97eb-701d9167c57d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:39.131249 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-4d90d405-20a2-4f11-97eb-701d9167c57d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:39.149631 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-4d90d405-20a2-4f11-97eb-701d9167c57d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.166793 Aug 03 13:00:39.150231 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 86/189] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:38 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:00:39.727866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-2e04ad19-ce76-4c78-9655-f49f85ebafdb req-34a62efc-aa83-4cf8-8b0f-1f67b8f91694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e92b94-74d5-4161-ab5d-80b10c84bfb1", "name": "network-vif-plugged", "status": "completed", "tag": "0950fa19-287f-4d83-950b-1cb1355203d6"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:00:39.737396 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-2e04ad19-ce76-4c78-9655-f49f85ebafdb req-34a62efc-aa83-4cf8-8b0f-1f67b8f91694 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:39.738592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-2e04ad19-ce76-4c78-9655-f49f85ebafdb req-34a62efc-aa83-4cf8-8b0f-1f67b8f91694 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:39.748297 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-92b3edb0-e183-4193-b55e-70bc2d42c5cd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:39.748888 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-92b3edb0-e183-4193-b55e-70bc2d42c5cd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:39.758679 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-2e04ad19-ce76-4c78-9655-f49f85ebafdb req-34a62efc-aa83-4cf8-8b0f-1f67b8f91694 service nova] Creating event network-vif-plugged:0950fa19-287f-4d83-950b-1cb1355203d6 for instance 67e92b94-74d5-4161-ab5d-80b10c84bfb1 on hv-cinder-85083 Aug 03 13:00:39.762062 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-92b3edb0-e183-4193-b55e-70bc2d42c5cd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:39.762512 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-92b3edb0-e183-4193-b55e-70bc2d42c5cd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:39.763295 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-92b3edb0-e183-4193-b55e-70bc2d42c5cd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:39.763724 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-92b3edb0-e183-4193-b55e-70bc2d42c5cd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:39.774172 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-2e04ad19-ce76-4c78-9655-f49f85ebafdb req-34a62efc-aa83-4cf8-8b0f-1f67b8f91694 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049805 Aug 03 13:00:39.775339 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 104/190] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:00:40.002371 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-bdbd1648-bdbb-456b-9374-22670ec5c021 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:40.004298 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-bdbd1648-bdbb-456b-9374-22670ec5c021 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:40.014914 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bdbd1648-bdbb-456b-9374-22670ec5c021 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:40.017132 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bdbd1648-bdbb-456b-9374-22670ec5c021 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:40.018226 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bdbd1648-bdbb-456b-9374-22670ec5c021 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:40.018900 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bdbd1648-bdbb-456b-9374-22670ec5c021 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:40.043017 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-92b3edb0-e183-4193-b55e-70bc2d42c5cd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:40.052989 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-92b3edb0-e183-4193-b55e-70bc2d42c5cd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:40.055202 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-92b3edb0-e183-4193-b55e-70bc2d42c5cd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:40.063526 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-92b3edb0-e183-4193-b55e-70bc2d42c5cd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.318895 Aug 03 13:00:40.074765 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 87/191] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:39 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:40.171197 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-641c5e85-a9b1-4c27-ace0-2576b301e7a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:40.171813 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-641c5e85-a9b1-4c27-ace0-2576b301e7a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:40.172277 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-bdbd1648-bdbb-456b-9374-22670ec5c021 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:40.177864 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-641c5e85-a9b1-4c27-ace0-2576b301e7a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:40.178853 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-641c5e85-a9b1-4c27-ace0-2576b301e7a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:40.179622 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-641c5e85-a9b1-4c27-ace0-2576b301e7a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:40.180055 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-641c5e85-a9b1-4c27-ace0-2576b301e7a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:40.181443 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-bdbd1648-bdbb-456b-9374-22670ec5c021 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1556 microversion: 2.1 time: 0.185035 Aug 03 13:00:40.182004 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 105/192] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:39 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1556 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:40.205793 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-a88820e9-2d91-4b07-af5e-99a1f2581c25 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:40.206449 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-a88820e9-2d91-4b07-af5e-99a1f2581c25 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:40.213384 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a88820e9-2d91-4b07-af5e-99a1f2581c25 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:40.213892 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a88820e9-2d91-4b07-af5e-99a1f2581c25 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:40.214664 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a88820e9-2d91-4b07-af5e-99a1f2581c25 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:40.215224 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a88820e9-2d91-4b07-af5e-99a1f2581c25 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:40.444423 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-641c5e85-a9b1-4c27-ace0-2576b301e7a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:40.457060 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-a88820e9-2d91-4b07-af5e-99a1f2581c25 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.255246 Aug 03 13:00:40.458179 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 106/193] 10.222.0.64 () {58 vars in 1275 bytes} [Wed Aug 3 13:00:40 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a/os-interface => generated 285 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:00:40.458681 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-641c5e85-a9b1-4c27-ace0-2576b301e7a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.288571 Aug 03 13:00:40.462177 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 88/194] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:40 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:00:41.090607 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-13bf9811-cc2c-4337-bdac-7e287c175249 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:41.092113 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-13bf9811-cc2c-4337-bdac-7e287c175249 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:41.099298 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-13bf9811-cc2c-4337-bdac-7e287c175249 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:41.100875 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-13bf9811-cc2c-4337-bdac-7e287c175249 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:41.101875 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-13bf9811-cc2c-4337-bdac-7e287c175249 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:41.102587 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-13bf9811-cc2c-4337-bdac-7e287c175249 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:41.493208 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-a687d4ea-2e71-4467-aa89-07a9e23ed524 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:41.493208 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-a687d4ea-2e71-4467-aa89-07a9e23ed524 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:41.518629 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a687d4ea-2e71-4467-aa89-07a9e23ed524 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:41.521007 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a687d4ea-2e71-4467-aa89-07a9e23ed524 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:41.521807 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a687d4ea-2e71-4467-aa89-07a9e23ed524 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:41.523874 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a687d4ea-2e71-4467-aa89-07a9e23ed524 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:41.781350 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-13bf9811-cc2c-4337-bdac-7e287c175249 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:41.799038 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-13bf9811-cc2c-4337-bdac-7e287c175249 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:41.800646 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-13bf9811-cc2c-4337-bdac-7e287c175249 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:41.802274 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-13bf9811-cc2c-4337-bdac-7e287c175249 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.717604 Aug 03 13:00:41.803173 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 107/195] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:41 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:41.837017 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-a687d4ea-2e71-4467-aa89-07a9e23ed524 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:41.856392 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-a687d4ea-2e71-4467-aa89-07a9e23ed524 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.371421 Aug 03 13:00:41.857202 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 89/196] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:41 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:00:42.503565 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-b25ffe39-e67e-4540-807c-e94d321a42d6 req-bbb2ce38-a926-452c-a06a-39729344ea11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8097a062-4988-48d8-b95f-404fdf23d14a", "tag": "c5ff7ffa-b21f-405c-b9b8-d4f1c6b84415"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:00:42.529386 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-b25ffe39-e67e-4540-807c-e94d321a42d6 req-bbb2ce38-a926-452c-a06a-39729344ea11 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:42.529702 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-b25ffe39-e67e-4540-807c-e94d321a42d6 req-bbb2ce38-a926-452c-a06a-39729344ea11 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:42.537993 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=100 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:42.556881 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-b25ffe39-e67e-4540-807c-e94d321a42d6 req-bbb2ce38-a926-452c-a06a-39729344ea11 service nova] Creating event network-changed:c5ff7ffa-b21f-405c-b9b8-d4f1c6b84415 for instance 8097a062-4988-48d8-b95f-404fdf23d14a on hv-cinder-85083 Aug 03 13:00:42.582412 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-b25ffe39-e67e-4540-807c-e94d321a42d6 req-bbb2ce38-a926-452c-a06a-39729344ea11 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085218 Aug 03 13:00:42.583335 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 108/197] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:00:42.825849 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-48dd2cb5-be8d-45e1-a2e9-69d202646786 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:42.826467 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-48dd2cb5-be8d-45e1-a2e9-69d202646786 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:42.833374 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-48dd2cb5-be8d-45e1-a2e9-69d202646786 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:42.834033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-48dd2cb5-be8d-45e1-a2e9-69d202646786 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:42.835722 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-48dd2cb5-be8d-45e1-a2e9-69d202646786 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:42.836315 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-48dd2cb5-be8d-45e1-a2e9-69d202646786 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:42.878279 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-770d802b-57a4-436b-a0f5-71a4db8903f9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:42.879067 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-770d802b-57a4-436b-a0f5-71a4db8903f9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:42.886110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-770d802b-57a4-436b-a0f5-71a4db8903f9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:42.892689 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-770d802b-57a4-436b-a0f5-71a4db8903f9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:42.892689 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-770d802b-57a4-436b-a0f5-71a4db8903f9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:42.892689 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-770d802b-57a4-436b-a0f5-71a4db8903f9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:43.142608 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-48dd2cb5-be8d-45e1-a2e9-69d202646786 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:43.159923 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-48dd2cb5-be8d-45e1-a2e9-69d202646786 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:43.168658 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-48dd2cb5-be8d-45e1-a2e9-69d202646786 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:43.170369 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-48dd2cb5-be8d-45e1-a2e9-69d202646786 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.348734 Aug 03 13:00:43.171759 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 90/198] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:42 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:43.280455 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-770d802b-57a4-436b-a0f5-71a4db8903f9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:43.313477 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-770d802b-57a4-436b-a0f5-71a4db8903f9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.439722 Aug 03 13:00:43.318256 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 109/199] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:42 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:00:43.840318 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-68268e33-495f-4fa6-9949-06b49409ecfc tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:43.840800 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-68268e33-495f-4fa6-9949-06b49409ecfc tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:43.853667 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-68268e33-495f-4fa6-9949-06b49409ecfc tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:43.854105 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-68268e33-495f-4fa6-9949-06b49409ecfc tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:43.855136 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-68268e33-495f-4fa6-9949-06b49409ecfc tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:43.855752 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-68268e33-495f-4fa6-9949-06b49409ecfc tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:43.887564 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-68268e33-495f-4fa6-9949-06b49409ecfc tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Going to try to terminate instance {{(pid=119410) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 13:00:44.196686 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-35e9e281-e8a2-488a-aeab-d64c364603ca tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:44.197705 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-35e9e281-e8a2-488a-aeab-d64c364603ca tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:44.207965 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-35e9e281-e8a2-488a-aeab-d64c364603ca tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:44.209796 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-35e9e281-e8a2-488a-aeab-d64c364603ca tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:44.211671 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-35e9e281-e8a2-488a-aeab-d64c364603ca tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:44.215143 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-35e9e281-e8a2-488a-aeab-d64c364603ca tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:44.335206 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-68268e33-495f-4fa6-9949-06b49409ecfc tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "DELETE /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 204 len: 0 microversion: 2.1 time: 0.506628 Aug 03 13:00:44.339484 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 91/200] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 3 13:00:43 2022] DELETE /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 13:00:44.345840 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-167e9ac9-36f5-4c22-82cb-1384881c0bcb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:44.346575 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-167e9ac9-36f5-4c22-82cb-1384881c0bcb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:44.375656 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-167e9ac9-36f5-4c22-82cb-1384881c0bcb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:44.377666 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-167e9ac9-36f5-4c22-82cb-1384881c0bcb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:44.379364 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-167e9ac9-36f5-4c22-82cb-1384881c0bcb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:44.381149 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-167e9ac9-36f5-4c22-82cb-1384881c0bcb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:44.464514 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-35e9e281-e8a2-488a-aeab-d64c364603ca tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:44.474557 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-35e9e281-e8a2-488a-aeab-d64c364603ca tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:44.476894 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-35e9e281-e8a2-488a-aeab-d64c364603ca tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:44.478369 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-35e9e281-e8a2-488a-aeab-d64c364603ca tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.285736 Aug 03 13:00:44.483905 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 110/201] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:44 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:44.489254 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-899c5511-96fd-480e-b9fe-8b9b30d7fe0c tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:44.490153 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-899c5511-96fd-480e-b9fe-8b9b30d7fe0c tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:44.501202 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-899c5511-96fd-480e-b9fe-8b9b30d7fe0c tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:44.502118 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-899c5511-96fd-480e-b9fe-8b9b30d7fe0c tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:44.503332 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-899c5511-96fd-480e-b9fe-8b9b30d7fe0c tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:44.504039 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-899c5511-96fd-480e-b9fe-8b9b30d7fe0c tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:44.822814 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-167e9ac9-36f5-4c22-82cb-1384881c0bcb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:44.838937 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-167e9ac9-36f5-4c22-82cb-1384881c0bcb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.493440 Aug 03 13:00:44.839858 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 92/202] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:44 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:45.024453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-899c5511-96fd-480e-b9fe-8b9b30d7fe0c tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:45.039155 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-899c5511-96fd-480e-b9fe-8b9b30d7fe0c tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1554 microversion: 2.1 time: 0.553760 Aug 03 13:00:45.042322 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 111/203] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:44 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1554 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:45.501248 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-4ecfba21-52fe-448d-9c05-3323be4cd344 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:45.501968 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-4ecfba21-52fe-448d-9c05-3323be4cd344 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:45.508493 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4ecfba21-52fe-448d-9c05-3323be4cd344 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:45.509022 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4ecfba21-52fe-448d-9c05-3323be4cd344 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:45.509846 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4ecfba21-52fe-448d-9c05-3323be4cd344 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:45.510290 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4ecfba21-52fe-448d-9c05-3323be4cd344 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:45.670909 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-4ecfba21-52fe-448d-9c05-3323be4cd344 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:45.681849 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-4ecfba21-52fe-448d-9c05-3323be4cd344 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:45.683702 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-4ecfba21-52fe-448d-9c05-3323be4cd344 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:45.685983 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-4ecfba21-52fe-448d-9c05-3323be4cd344 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.188783 Aug 03 13:00:45.687369 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 93/204] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:45 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:45.860679 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-deefe1c8-a1b5-4444-9c7b-2ba688c75502 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:45.861327 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-deefe1c8-a1b5-4444-9c7b-2ba688c75502 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:45.867569 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-deefe1c8-a1b5-4444-9c7b-2ba688c75502 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:45.868015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-deefe1c8-a1b5-4444-9c7b-2ba688c75502 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:45.868781 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-deefe1c8-a1b5-4444-9c7b-2ba688c75502 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:45.869281 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-deefe1c8-a1b5-4444-9c7b-2ba688c75502 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:46.064807 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-32e3d08d-61a0-4e14-9afc-c42e0701f4ca tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:46.065431 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-32e3d08d-61a0-4e14-9afc-c42e0701f4ca tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:46.075171 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-32e3d08d-61a0-4e14-9afc-c42e0701f4ca tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:46.075769 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-32e3d08d-61a0-4e14-9afc-c42e0701f4ca tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:46.077224 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-32e3d08d-61a0-4e14-9afc-c42e0701f4ca tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:46.077832 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-32e3d08d-61a0-4e14-9afc-c42e0701f4ca tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:46.109034 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-deefe1c8-a1b5-4444-9c7b-2ba688c75502 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:46.123687 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-deefe1c8-a1b5-4444-9c7b-2ba688c75502 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.266548 Aug 03 13:00:46.125076 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 112/205] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:45 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:46.296024 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-32e3d08d-61a0-4e14-9afc-c42e0701f4ca tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:46.304287 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-32e3d08d-61a0-4e14-9afc-c42e0701f4ca tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1554 microversion: 2.1 time: 0.244160 Aug 03 13:00:46.304868 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 94/206] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:46 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1554 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:46.711986 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-82686b6d-a772-4da1-b4c2-500926449c2c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:46.712829 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-82686b6d-a772-4da1-b4c2-500926449c2c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:46.719672 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-82686b6d-a772-4da1-b4c2-500926449c2c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:46.720218 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-82686b6d-a772-4da1-b4c2-500926449c2c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:46.721095 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-82686b6d-a772-4da1-b4c2-500926449c2c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:46.721643 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-82686b6d-a772-4da1-b4c2-500926449c2c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:46.959428 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-82686b6d-a772-4da1-b4c2-500926449c2c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:46.969706 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-82686b6d-a772-4da1-b4c2-500926449c2c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:46.972910 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-82686b6d-a772-4da1-b4c2-500926449c2c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:46.973428 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-82686b6d-a772-4da1-b4c2-500926449c2c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1407 microversion: 2.20 time: 0.266312 Aug 03 13:00:46.988598 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 113/207] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:46 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:47.152948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-0cd79995-a44a-4040-bcda-c6d4d25eaee4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:47.154344 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-0cd79995-a44a-4040-bcda-c6d4d25eaee4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:47.174346 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0cd79995-a44a-4040-bcda-c6d4d25eaee4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:47.175346 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0cd79995-a44a-4040-bcda-c6d4d25eaee4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:47.176141 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0cd79995-a44a-4040-bcda-c6d4d25eaee4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:47.176583 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0cd79995-a44a-4040-bcda-c6d4d25eaee4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:47.330832 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-2309e593-4d32-459c-8632-34571aa1b9e0 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:47.333769 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-2309e593-4d32-459c-8632-34571aa1b9e0 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:47.346183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2309e593-4d32-459c-8632-34571aa1b9e0 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:47.346802 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2309e593-4d32-459c-8632-34571aa1b9e0 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:47.347741 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2309e593-4d32-459c-8632-34571aa1b9e0 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:47.348170 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2309e593-4d32-459c-8632-34571aa1b9e0 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:47.462437 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-0cd79995-a44a-4040-bcda-c6d4d25eaee4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:47.475433 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-0cd79995-a44a-4040-bcda-c6d4d25eaee4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.333243 Aug 03 13:00:47.476031 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 95/208] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:47 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:47.565372 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-2309e593-4d32-459c-8632-34571aa1b9e0 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:47.577580 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-2309e593-4d32-459c-8632-34571aa1b9e0 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1554 microversion: 2.1 time: 0.251084 Aug 03 13:00:47.577580 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 114/209] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:47 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1554 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:47.999859 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-bd2af7d7-1059-486f-9281-c1cfd9dc8b2b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:48.000404 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-bd2af7d7-1059-486f-9281-c1cfd9dc8b2b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:48.007869 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bd2af7d7-1059-486f-9281-c1cfd9dc8b2b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:48.008367 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bd2af7d7-1059-486f-9281-c1cfd9dc8b2b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:48.009261 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bd2af7d7-1059-486f-9281-c1cfd9dc8b2b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:48.009698 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bd2af7d7-1059-486f-9281-c1cfd9dc8b2b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:48.220373 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-bd2af7d7-1059-486f-9281-c1cfd9dc8b2b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:48.231665 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-bd2af7d7-1059-486f-9281-c1cfd9dc8b2b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:48.235293 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-bd2af7d7-1059-486f-9281-c1cfd9dc8b2b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:48.237402 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-bd2af7d7-1059-486f-9281-c1cfd9dc8b2b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1599 microversion: 2.20 time: 0.241313 Aug 03 13:00:48.257339 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 96/210] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:00:47 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1599 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:00:48.264514 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-abddd5b6-9d8e-4a4d-9b2e-b6a055559562 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:48.265557 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-abddd5b6-9d8e-4a4d-9b2e-b6a055559562 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:48.273025 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-abddd5b6-9d8e-4a4d-9b2e-b6a055559562 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:48.278497 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-abddd5b6-9d8e-4a4d-9b2e-b6a055559562 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:48.278497 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-abddd5b6-9d8e-4a4d-9b2e-b6a055559562 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:48.278497 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-abddd5b6-9d8e-4a4d-9b2e-b6a055559562 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:48.453412 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-abddd5b6-9d8e-4a4d-9b2e-b6a055559562 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.192924 Aug 03 13:00:48.457613 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 115/211] 10.222.0.64 () {60 vars in 1316 bytes} [Wed Aug 3 13:00:48 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1/os-interface => generated 284 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 13:00:48.497426 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-38328e76-75e8-4e93-85b1-1bbe921e9903 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:48.498959 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-38328e76-75e8-4e93-85b1-1bbe921e9903 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:48.507728 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-38328e76-75e8-4e93-85b1-1bbe921e9903 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:48.508647 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-38328e76-75e8-4e93-85b1-1bbe921e9903 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:48.509724 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-38328e76-75e8-4e93-85b1-1bbe921e9903 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:48.510330 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-38328e76-75e8-4e93-85b1-1bbe921e9903 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:48.603215 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-980bae4d-7dbf-4cce-ba5e-5581777ee49e tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:48.603215 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-980bae4d-7dbf-4cce-ba5e-5581777ee49e tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:48.616590 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-980bae4d-7dbf-4cce-ba5e-5581777ee49e tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:48.617373 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-980bae4d-7dbf-4cce-ba5e-5581777ee49e tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:48.618541 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-980bae4d-7dbf-4cce-ba5e-5581777ee49e tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:48.619993 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-980bae4d-7dbf-4cce-ba5e-5581777ee49e tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:48.991257 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-38328e76-75e8-4e93-85b1-1bbe921e9903 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:49.002775 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-38328e76-75e8-4e93-85b1-1bbe921e9903 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.510190 Aug 03 13:00:49.005359 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 97/212] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:48 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:49.129417 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-980bae4d-7dbf-4cce-ba5e-5581777ee49e tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:49.139886 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-980bae4d-7dbf-4cce-ba5e-5581777ee49e tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1554 microversion: 2.1 time: 0.547630 Aug 03 13:00:49.147802 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 116/213] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:48 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1554 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:50.026120 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-8578c54b-9365-4719-bbf4-1b1a15b1fc53 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:50.027877 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-8578c54b-9365-4719-bbf4-1b1a15b1fc53 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:50.037579 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8578c54b-9365-4719-bbf4-1b1a15b1fc53 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:50.038612 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8578c54b-9365-4719-bbf4-1b1a15b1fc53 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:50.039607 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8578c54b-9365-4719-bbf4-1b1a15b1fc53 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:50.040654 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8578c54b-9365-4719-bbf4-1b1a15b1fc53 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:50.078960 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:50.169514 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-034ac5c5-9dec-4b26-8bb4-582d10904dd6 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:50.170664 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-034ac5c5-9dec-4b26-8bb4-582d10904dd6 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:50.180652 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-034ac5c5-9dec-4b26-8bb4-582d10904dd6 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:50.181509 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-034ac5c5-9dec-4b26-8bb4-582d10904dd6 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:50.183045 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-034ac5c5-9dec-4b26-8bb4-582d10904dd6 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:50.183691 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-034ac5c5-9dec-4b26-8bb4-582d10904dd6 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:50.357155 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-8578c54b-9365-4719-bbf4-1b1a15b1fc53 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:50.366967 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-8578c54b-9365-4719-bbf4-1b1a15b1fc53 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.345715 Aug 03 13:00:50.379707 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 98/214] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:50 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:50.458715 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-034ac5c5-9dec-4b26-8bb4-582d10904dd6 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:50.482682 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-034ac5c5-9dec-4b26-8bb4-582d10904dd6 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1554 microversion: 2.1 time: 0.317482 Aug 03 13:00:50.486273 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 117/215] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:50 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1554 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:50.582862 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-018cd1b3-0ad8-48a9-8547-88925069bee8 req-b8fa8f39-790c-478b-8212-c8a54f4e5793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c576c6-074d-43df-b155-f95b3cd5bb79", "name": "network-vif-deleted", "tag": "df70904f-7704-4b3b-b5b7-912d817eb793"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:00:50.603280 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-018cd1b3-0ad8-48a9-8547-88925069bee8 req-b8fa8f39-790c-478b-8212-c8a54f4e5793 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:50.603908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-018cd1b3-0ad8-48a9-8547-88925069bee8 req-b8fa8f39-790c-478b-8212-c8a54f4e5793 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:50.612850 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-e1bdb0cc-b662-4340-9aa4-b44232718e65 req-5458708c-8473-4603-897f-d4e06863b73e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67e92b94-74d5-4161-ab5d-80b10c84bfb1", "tag": "0950fa19-287f-4d83-950b-1cb1355203d6"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:00:50.619708 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-018cd1b3-0ad8-48a9-8547-88925069bee8 req-b8fa8f39-790c-478b-8212-c8a54f4e5793 service nova] Creating event network-vif-deleted:df70904f-7704-4b3b-b5b7-912d817eb793 for instance 20c576c6-074d-43df-b155-f95b3cd5bb79 on hv-cinder-85083 Aug 03 13:00:50.626544 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-018cd1b3-0ad8-48a9-8547-88925069bee8 req-b8fa8f39-790c-478b-8212-c8a54f4e5793 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055892 Aug 03 13:00:50.627712 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 99/216] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:00:50.627891 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-e1bdb0cc-b662-4340-9aa4-b44232718e65 req-5458708c-8473-4603-897f-d4e06863b73e service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:50.629926 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-e1bdb0cc-b662-4340-9aa4-b44232718e65 req-5458708c-8473-4603-897f-d4e06863b73e service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:50.658237 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-e1bdb0cc-b662-4340-9aa4-b44232718e65 req-5458708c-8473-4603-897f-d4e06863b73e service nova] Creating event network-changed:0950fa19-287f-4d83-950b-1cb1355203d6 for instance 67e92b94-74d5-4161-ab5d-80b10c84bfb1 on hv-cinder-85083 Aug 03 13:00:50.672923 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-e1bdb0cc-b662-4340-9aa4-b44232718e65 req-5458708c-8473-4603-897f-d4e06863b73e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069206 Aug 03 13:00:50.679537 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 118/217] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 03 13:00:51.395660 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-65434c61-fdf9-4d49-8a98-ebd0f6ab989b tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:51.396430 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-65434c61-fdf9-4d49-8a98-ebd0f6ab989b tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:51.410364 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-65434c61-fdf9-4d49-8a98-ebd0f6ab989b tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:51.419251 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-65434c61-fdf9-4d49-8a98-ebd0f6ab989b tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:51.421404 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-65434c61-fdf9-4d49-8a98-ebd0f6ab989b tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:51.421857 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-65434c61-fdf9-4d49-8a98-ebd0f6ab989b tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:51.504270 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-4735fdca-6bef-495a-a0a2-86bdf578d045 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:51.504959 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-4735fdca-6bef-495a-a0a2-86bdf578d045 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:51.514153 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4735fdca-6bef-495a-a0a2-86bdf578d045 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:51.514607 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4735fdca-6bef-495a-a0a2-86bdf578d045 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:51.515395 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4735fdca-6bef-495a-a0a2-86bdf578d045 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:51.515857 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4735fdca-6bef-495a-a0a2-86bdf578d045 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:51.658337 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-4735fdca-6bef-495a-a0a2-86bdf578d045 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:51.673301 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-4735fdca-6bef-495a-a0a2-86bdf578d045 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1346 microversion: 2.1 time: 0.173012 Aug 03 13:00:51.674493 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 119/218] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:51 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1346 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:00:51.705665 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-65434c61-fdf9-4d49-8a98-ebd0f6ab989b tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:51.713285 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-65434c61-fdf9-4d49-8a98-ebd0f6ab989b tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.326698 Aug 03 13:00:51.714204 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 100/219] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:51 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:52.695637 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-90b7016e-deca-4da6-bda7-b8682d1d9589 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:52.699385 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-90b7016e-deca-4da6-bda7-b8682d1d9589 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:52.712053 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-90b7016e-deca-4da6-bda7-b8682d1d9589 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:52.712829 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-90b7016e-deca-4da6-bda7-b8682d1d9589 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:52.722663 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-90b7016e-deca-4da6-bda7-b8682d1d9589 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:52.723501 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-90b7016e-deca-4da6-bda7-b8682d1d9589 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:52.736431 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-71ed376f-d133-4812-bb09-25696b2d633f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:52.737542 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-71ed376f-d133-4812-bb09-25696b2d633f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:52.763897 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-71ed376f-d133-4812-bb09-25696b2d633f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:52.770541 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-71ed376f-d133-4812-bb09-25696b2d633f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:52.773578 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-71ed376f-d133-4812-bb09-25696b2d633f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:52.774273 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-71ed376f-d133-4812-bb09-25696b2d633f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:52.812810 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-90b7016e-deca-4da6-bda7-b8682d1d9589 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:52.813520 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-90b7016e-deca-4da6-bda7-b8682d1d9589 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:52.814313 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.objects.instance [None req-90b7016e-deca-4da6-bda7-b8682d1d9589 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lazy-loading 'fault' on Instance uuid 20c576c6-074d-43df-b155-f95b3cd5bb79 {{(pid=119409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:00:52.899307 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-90b7016e-deca-4da6-bda7-b8682d1d9589 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf46bef60464329afdf2df75842a41e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:52.923862 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-90b7016e-deca-4da6-bda7-b8682d1d9589 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 200 len: 1351 microversion: 2.1 time: 0.219374 Aug 03 13:00:52.928288 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 120/220] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:52 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 1351 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:53.062641 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-71ed376f-d133-4812-bb09-25696b2d633f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:53.073760 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-71ed376f-d133-4812-bb09-25696b2d633f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.341190 Aug 03 13:00:53.076479 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 101/221] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:52 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:53.949849 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-03516ca1-1082-4113-b928-8f33d91e9670 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:53.950453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-03516ca1-1082-4113-b928-8f33d91e9670 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:53.956771 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-03516ca1-1082-4113-b928-8f33d91e9670 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:53.957219 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-03516ca1-1082-4113-b928-8f33d91e9670 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:53.958087 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-03516ca1-1082-4113-b928-8f33d91e9670 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:53.958522 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-03516ca1-1082-4113-b928-8f33d91e9670 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:53.972863 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-03516ca1-1082-4113-b928-8f33d91e9670 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] HTTP exception thrown: Instance 20c576c6-074d-43df-b155-f95b3cd5bb79 could not be found. Aug 03 13:00:53.977621 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-03516ca1-1082-4113-b928-8f33d91e9670 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Request method failure captured: Aug 03 13:00:53.977621 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 HTTP/1.1 Aug 03 13:00:53.977621 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 13:00:53.977621 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 13:00:53.977621 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 13:00:53.977621 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 0 Aug 03 13:00:53.977621 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 13:00:53.977621 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 13:00:53.977621 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 13:00:53.977621 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 13:00:53.977621 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nE3i5y4GeNIlYPUEaSce5IRZ5t0K-C8nQgck6vu-2yC9eHTflLeTY9bRf_6m23ka9v331Q6oMEmZEoariMP1Jbo9yelClUeK6SILJ4o5E75ivdFxTTcv9ccdx-uXNcWgq3pQ4uRQBXghzhWMAFc13IUE6W_sRdEd2tjjSRZyrPFwgg Aug 03 13:00:53.977621 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 13:00:53.977621 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 13:00:53.977621 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 13:00:53.977621 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 13:00:53.977621 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 13:00:53.977621 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 13:00:53.977621 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: b4c4a2f8c7864ee692c5b1b55b4aacac Aug 03 13:00:53.977621 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-DeleteServersTestJSON-839781773 Aug 03 13:00:53.977621 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 13:00:53.977621 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 13:00:53.979231 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/b4c4a2f8c7864ee692c5b1b55b4aacac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b4c4a2f8c7864ee692c5b1b55b4aacac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b4c4a2f8c7864ee692c5b1b55b4aacac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_b4c4a2f8c7864ee692c5b1b55b4aacac", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:00:53.979231 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-DeleteServersTestJSON-839781773 Aug 03 13:00:53.979231 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: b4c4a2f8c7864ee692c5b1b55b4aacac Aug 03 13:00:53.979231 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-DeleteServersTestJSON-839781773 Aug 03 13:00:53.979231 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-DeleteServersTestJSON-839781773-project Aug 03 13:00:53.979231 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 13:00:53.979231 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 13:00:53.979231 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: bbf46bef60464329afdf2df75842a41e Aug 03 13:00:53.979231 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-DeleteServersTestJSON-839781773-project Aug 03 13:00:53.979231 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: > Aug 03 13:00:53.979231 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Instance 20c576c6-074d-43df-b155-f95b3cd5bb79 could not be found. Aug 03 13:00:53.979231 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'id': '20c576c6-074d-43df-b155-f95b3cd5bb79'} Aug 03 13:00:53.979987 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:00:53.979987 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:00:53.979987 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:00:53.979987 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:00:53.979987 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:00:53.979987 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:00:53.979987 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:00:53.979987 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:00:53.979987 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:00:53.979987 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:00:53.979987 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20c576c6-074d-43df-b155-f95b3cd5bb79 could not be found. Aug 03 13:00:53.979987 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:00:53.979987 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:00:53.979987 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:00:53.979987 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:00:53.979987 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:00:53.979987 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:00:53.979987 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:00:53.979987 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:00:53.979987 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:00:53.981376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:00:53.981376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:00:53.981376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:00:53.981376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:00:53.981376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:00:53.981376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:00:53.981376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:00:53.981376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20c576c6-074d-43df-b155-f95b3cd5bb79 could not be found. Aug 03 13:00:53.981376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:00:53.981376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:00:53.981376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:00:53.981376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:00:53.981376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:00:53.981376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:00:53.981376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:00:53.981376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:00:53.981376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20c576c6-074d-43df-b155-f95b3cd5bb79 could not be found. Aug 03 13:00:53.981376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:00:53.982556 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-03516ca1-1082-4113-b928-8f33d91e9670 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Returning 404 to user: Instance 20c576c6-074d-43df-b155-f95b3cd5bb79 could not be found. {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:00:53.982556 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-03516ca1-1082-4113-b928-8f33d91e9670 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 404 len: 111 microversion: 2.1 time: 0.033137 Aug 03 13:00:53.982556 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 121/222] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:53 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 13:00:54.095615 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d640d1ed-ecbb-4985-aadd-b329af8dd212 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:54.100328 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d640d1ed-ecbb-4985-aadd-b329af8dd212 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:54.117934 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d640d1ed-ecbb-4985-aadd-b329af8dd212 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:54.120189 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d640d1ed-ecbb-4985-aadd-b329af8dd212 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:54.121107 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d640d1ed-ecbb-4985-aadd-b329af8dd212 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:54.121588 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d640d1ed-ecbb-4985-aadd-b329af8dd212 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:54.191903 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-63af39a7-350e-4ff6-9f78-cce7c31dc63c tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:54.195538 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-63af39a7-350e-4ff6-9f78-cce7c31dc63c tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:54.202541 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-63af39a7-350e-4ff6-9f78-cce7c31dc63c tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:54.203033 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-63af39a7-350e-4ff6-9f78-cce7c31dc63c tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:54.203892 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-63af39a7-350e-4ff6-9f78-cce7c31dc63c tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:54.204310 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-63af39a7-350e-4ff6-9f78-cce7c31dc63c tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:54.234329 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-63af39a7-350e-4ff6-9f78-cce7c31dc63c tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] HTTP exception thrown: Instance 20c576c6-074d-43df-b155-f95b3cd5bb79 could not be found. Aug 03 13:00:54.237280 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-63af39a7-350e-4ff6-9f78-cce7c31dc63c tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Request method failure captured: Aug 03 13:00:54.237280 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79/os-volume_attachments HTTP/1.1 Aug 03 13:00:54.237280 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 13:00:54.237280 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 13:00:54.237280 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 13:00:54.237280 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 0 Aug 03 13:00:54.237280 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 13:00:54.237280 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 13:00:54.237280 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 13:00:54.237280 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 13:00:54.237280 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nE3i5y4GeNIlYPUEaSce5IRZ5t0K-C8nQgck6vu-2yC9eHTflLeTY9bRf_6m23ka9v331Q6oMEmZEoariMP1Jbo9yelClUeK6SILJ4o5E75ivdFxTTcv9ccdx-uXNcWgq3pQ4uRQBXghzhWMAFc13IUE6W_sRdEd2tjjSRZyrPFwgg Aug 03 13:00:54.237280 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 13:00:54.237280 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 13:00:54.237280 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 13:00:54.237280 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 13:00:54.237280 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 13:00:54.237280 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 13:00:54.237280 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: b4c4a2f8c7864ee692c5b1b55b4aacac Aug 03 13:00:54.237280 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-DeleteServersTestJSON-839781773 Aug 03 13:00:54.237280 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 13:00:54.237280 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 13:00:54.238653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/b4c4a2f8c7864ee692c5b1b55b4aacac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b4c4a2f8c7864ee692c5b1b55b4aacac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b4c4a2f8c7864ee692c5b1b55b4aacac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_b4c4a2f8c7864ee692c5b1b55b4aacac", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:00:54.238653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-DeleteServersTestJSON-839781773 Aug 03 13:00:54.238653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: b4c4a2f8c7864ee692c5b1b55b4aacac Aug 03 13:00:54.238653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-DeleteServersTestJSON-839781773 Aug 03 13:00:54.238653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-DeleteServersTestJSON-839781773-project Aug 03 13:00:54.238653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 13:00:54.238653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 13:00:54.238653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: bbf46bef60464329afdf2df75842a41e Aug 03 13:00:54.238653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-DeleteServersTestJSON-839781773-project Aug 03 13:00:54.238653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: > Aug 03 13:00:54.238653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Instance 20c576c6-074d-43df-b155-f95b3cd5bb79 could not be found. Aug 03 13:00:54.238653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'server_id': '20c576c6-074d-43df-b155-f95b3cd5bb79'} Aug 03 13:00:54.239497 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:00:54.239497 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:00:54.239497 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:00:54.239497 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:00:54.239497 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:00:54.239497 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:00:54.239497 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:00:54.239497 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:00:54.239497 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:00:54.239497 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:00:54.239497 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20c576c6-074d-43df-b155-f95b3cd5bb79 could not be found. Aug 03 13:00:54.239497 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:00:54.239497 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:00:54.239497 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:00:54.239497 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:00:54.239497 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:00:54.239497 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:00:54.239497 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:00:54.239497 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:00:54.239497 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:00:54.241423 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:00:54.241423 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 13:00:54.241423 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 13:00:54.241423 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 13:00:54.241423 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 13:00:54.241423 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 03 13:00:54.241423 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 03 13:00:54.241423 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:00:54.241423 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:00:54.241423 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20c576c6-074d-43df-b155-f95b3cd5bb79 could not be found. Aug 03 13:00:54.241423 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:00:54.241423 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:00:54.241423 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:00:54.241423 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:00:54.241423 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:00:54.241423 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:00:54.241423 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:00:54.241423 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:00:54.241423 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20c576c6-074d-43df-b155-f95b3cd5bb79 could not be found. Aug 03 13:00:54.241423 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:00:54.256607 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-63af39a7-350e-4ff6-9f78-cce7c31dc63c tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Returning 404 to user: Instance 20c576c6-074d-43df-b155-f95b3cd5bb79 could not be found. {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:00:54.260331 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-63af39a7-350e-4ff6-9f78-cce7c31dc63c tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.067003 Aug 03 13:00:54.265339 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 122/223] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 3 13:00:54 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79/os-volume_attachments => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:00:54.438228 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d640d1ed-ecbb-4985-aadd-b329af8dd212 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:54.446882 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d640d1ed-ecbb-4985-aadd-b329af8dd212 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.356400 Aug 03 13:00:54.448046 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 102/224] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:54 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:55.467553 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-9340c347-c00d-4c9a-ab32-c67f0185dbb2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:55.468268 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-9340c347-c00d-4c9a-ab32-c67f0185dbb2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:55.475817 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=91 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:55.478900 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9340c347-c00d-4c9a-ab32-c67f0185dbb2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:55.479357 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9340c347-c00d-4c9a-ab32-c67f0185dbb2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:55.480137 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9340c347-c00d-4c9a-ab32-c67f0185dbb2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:55.480630 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9340c347-c00d-4c9a-ab32-c67f0185dbb2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:55.639607 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-9340c347-c00d-4c9a-ab32-c67f0185dbb2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:55.647659 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-9340c347-c00d-4c9a-ab32-c67f0185dbb2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.184177 Aug 03 13:00:55.648335 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 123/225] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:55 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:55.763211 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-40a19ad3-523a-4b0d-a9fd-930dae47ab06 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:55.764529 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-40a19ad3-523a-4b0d-a9fd-930dae47ab06 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:55.773608 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-40a19ad3-523a-4b0d-a9fd-930dae47ab06 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:55.774061 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-40a19ad3-523a-4b0d-a9fd-930dae47ab06 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:55.775805 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-40a19ad3-523a-4b0d-a9fd-930dae47ab06 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:55.776523 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-40a19ad3-523a-4b0d-a9fd-930dae47ab06 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:55.799402 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.wsgi [None req-40a19ad3-523a-4b0d-a9fd-930dae47ab06 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] HTTP exception thrown: Instance 20c576c6-074d-43df-b155-f95b3cd5bb79 could not be found. Aug 03 13:00:55.804793 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-40a19ad3-523a-4b0d-a9fd-930dae47ab06 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Request method failure captured: Aug 03 13:00:55.804793 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: request: DELETE /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 HTTP/1.1 Aug 03 13:00:55.804793 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept: application/json Aug 03 13:00:55.804793 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept-Encoding: identity Aug 03 13:00:55.804793 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Connection: close Aug 03 13:00:55.804793 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Length: 0 Aug 03 13:00:55.804793 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Type: application/json Aug 03 13:00:55.804793 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Host: 10.222.0.64 Aug 03 13:00:55.804793 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Openstack-System-Scope: None Aug 03 13:00:55.804793 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: User-Agent: python-urllib3/1.26.10 Aug 03 13:00:55.804793 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Auth-Token: gAAAAABi6nE3i5y4GeNIlYPUEaSce5IRZ5t0K-C8nQgck6vu-2yC9eHTflLeTY9bRf_6m23ka9v331Q6oMEmZEoariMP1Jbo9yelClUeK6SILJ4o5E75ivdFxTTcv9ccdx-uXNcWgq3pQ4uRQBXghzhWMAFc13IUE6W_sRdEd2tjjSRZyrPFwgg Aug 03 13:00:55.804793 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Id: None Aug 03 13:00:55.804793 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Name: None Aug 03 13:00:55.804793 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Identity-Status: Confirmed Aug 03 13:00:55.804793 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Is-Admin-Project: True Aug 03 13:00:55.804793 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Id: default Aug 03 13:00:55.804793 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Name: Default Aug 03 13:00:55.804793 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Id: b4c4a2f8c7864ee692c5b1b55b4aacac Aug 03 13:00:55.804793 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Name: tempest-DeleteServersTestJSON-839781773 Aug 03 13:00:55.804793 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Role: member,reader Aug 03 13:00:55.804793 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Roles: member,reader Aug 03 13:00:55.805998 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/b4c4a2f8c7864ee692c5b1b55b4aacac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b4c4a2f8c7864ee692c5b1b55b4aacac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b4c4a2f8c7864ee692c5b1b55b4aacac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_b4c4a2f8c7864ee692c5b1b55b4aacac", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:00:55.805998 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant: tempest-DeleteServersTestJSON-839781773 Aug 03 13:00:55.805998 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Id: b4c4a2f8c7864ee692c5b1b55b4aacac Aug 03 13:00:55.805998 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Name: tempest-DeleteServersTestJSON-839781773 Aug 03 13:00:55.805998 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User: tempest-DeleteServersTestJSON-839781773-project Aug 03 13:00:55.805998 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Id: default Aug 03 13:00:55.805998 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Name: Default Aug 03 13:00:55.805998 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Id: bbf46bef60464329afdf2df75842a41e Aug 03 13:00:55.805998 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Name: tempest-DeleteServersTestJSON-839781773-project Aug 03 13:00:55.805998 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: method: > Aug 03 13:00:55.805998 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: exception: Instance 20c576c6-074d-43df-b155-f95b3cd5bb79 could not be found. Aug 03 13:00:55.805998 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: action_args: {'id': '20c576c6-074d-43df-b155-f95b3cd5bb79'} Aug 03 13:00:55.806788 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:00:55.806788 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:00:55.806788 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:00:55.806788 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:00:55.806788 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:00:55.806788 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:00:55.806788 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:00:55.806788 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:00:55.806788 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:00:55.806788 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:00:55.806788 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20c576c6-074d-43df-b155-f95b3cd5bb79 could not be found. Aug 03 13:00:55.806788 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:00:55.806788 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:00:55.806788 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:00:55.806788 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:00:55.806788 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:00:55.806788 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:00:55.806788 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:00:55.806788 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:00:55.806788 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:00:55.808000 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:00:55.808000 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 13:00:55.808000 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 13:00:55.808000 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 13:00:55.808000 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 13:00:55.808000 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:00:55.808000 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:00:55.808000 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:00:55.808000 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:00:55.808000 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20c576c6-074d-43df-b155-f95b3cd5bb79 could not be found. Aug 03 13:00:55.808000 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:00:55.808000 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:00:55.808000 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:00:55.808000 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:00:55.808000 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:00:55.808000 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:00:55.808000 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:00:55.808000 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:00:55.808000 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20c576c6-074d-43df-b155-f95b3cd5bb79 could not be found. Aug 03 13:00:55.808000 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:00:55.809275 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-40a19ad3-523a-4b0d-a9fd-930dae47ab06 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Returning 404 to user: Instance 20c576c6-074d-43df-b155-f95b3cd5bb79 could not be found. {{(pid=119410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:00:55.809275 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-40a19ad3-523a-4b0d-a9fd-930dae47ab06 tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "DELETE /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 404 len: 111 microversion: 2.1 time: 0.047904 Aug 03 13:00:55.809275 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 103/226] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 3 13:00:55 2022] DELETE /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:00:55.815788 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-1cbff59b-dbf0-4fa0-a51f-87a8e3f260ff tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:55.816401 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-1cbff59b-dbf0-4fa0-a51f-87a8e3f260ff tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] [instance: 20c576c6-074d-43df-b155-f95b3cd5bb79] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:55.823241 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1cbff59b-dbf0-4fa0-a51f-87a8e3f260ff tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:55.824632 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1cbff59b-dbf0-4fa0-a51f-87a8e3f260ff tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:55.825413 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1cbff59b-dbf0-4fa0-a51f-87a8e3f260ff tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:55.825849 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1cbff59b-dbf0-4fa0-a51f-87a8e3f260ff tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:55.842707 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-1cbff59b-dbf0-4fa0-a51f-87a8e3f260ff tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] HTTP exception thrown: Instance 20c576c6-074d-43df-b155-f95b3cd5bb79 could not be found. Aug 03 13:00:55.844532 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-1cbff59b-dbf0-4fa0-a51f-87a8e3f260ff tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Request method failure captured: Aug 03 13:00:55.844532 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 HTTP/1.1 Aug 03 13:00:55.844532 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 13:00:55.844532 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 13:00:55.844532 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 13:00:55.844532 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 0 Aug 03 13:00:55.844532 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 13:00:55.844532 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 13:00:55.844532 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 13:00:55.844532 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 13:00:55.844532 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nE3i5y4GeNIlYPUEaSce5IRZ5t0K-C8nQgck6vu-2yC9eHTflLeTY9bRf_6m23ka9v331Q6oMEmZEoariMP1Jbo9yelClUeK6SILJ4o5E75ivdFxTTcv9ccdx-uXNcWgq3pQ4uRQBXghzhWMAFc13IUE6W_sRdEd2tjjSRZyrPFwgg Aug 03 13:00:55.844532 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 13:00:55.844532 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 13:00:55.844532 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 13:00:55.844532 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 13:00:55.844532 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 13:00:55.844532 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 13:00:55.844532 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: b4c4a2f8c7864ee692c5b1b55b4aacac Aug 03 13:00:55.844532 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-DeleteServersTestJSON-839781773 Aug 03 13:00:55.844532 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 13:00:55.844532 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 13:00:55.845976 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/b4c4a2f8c7864ee692c5b1b55b4aacac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b4c4a2f8c7864ee692c5b1b55b4aacac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b4c4a2f8c7864ee692c5b1b55b4aacac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_b4c4a2f8c7864ee692c5b1b55b4aacac", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:00:55.845976 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-DeleteServersTestJSON-839781773 Aug 03 13:00:55.845976 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: b4c4a2f8c7864ee692c5b1b55b4aacac Aug 03 13:00:55.845976 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-DeleteServersTestJSON-839781773 Aug 03 13:00:55.845976 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-DeleteServersTestJSON-839781773-project Aug 03 13:00:55.845976 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 13:00:55.845976 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 13:00:55.845976 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: bbf46bef60464329afdf2df75842a41e Aug 03 13:00:55.845976 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-DeleteServersTestJSON-839781773-project Aug 03 13:00:55.845976 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: > Aug 03 13:00:55.845976 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Instance 20c576c6-074d-43df-b155-f95b3cd5bb79 could not be found. Aug 03 13:00:55.845976 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'id': '20c576c6-074d-43df-b155-f95b3cd5bb79'} Aug 03 13:00:55.846910 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:00:55.846910 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:00:55.846910 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:00:55.846910 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:00:55.846910 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:00:55.846910 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:00:55.846910 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:00:55.846910 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:00:55.846910 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:00:55.846910 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:00:55.846910 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20c576c6-074d-43df-b155-f95b3cd5bb79 could not be found. Aug 03 13:00:55.846910 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:00:55.846910 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:00:55.846910 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:00:55.846910 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:00:55.846910 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:00:55.846910 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:00:55.846910 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:00:55.846910 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:00:55.846910 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:00:55.848850 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:00:55.848850 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:00:55.848850 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:00:55.848850 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:00:55.848850 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:00:55.848850 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:00:55.848850 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:00:55.848850 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20c576c6-074d-43df-b155-f95b3cd5bb79 could not be found. Aug 03 13:00:55.848850 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:00:55.848850 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:00:55.848850 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:00:55.848850 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:00:55.848850 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:00:55.848850 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:00:55.848850 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:00:55.848850 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:00:55.848850 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20c576c6-074d-43df-b155-f95b3cd5bb79 could not be found. Aug 03 13:00:55.848850 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:00:55.850406 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-1cbff59b-dbf0-4fa0-a51f-87a8e3f260ff tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] Returning 404 to user: Instance 20c576c6-074d-43df-b155-f95b3cd5bb79 could not be found. {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:00:55.850406 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-1cbff59b-dbf0-4fa0-a51f-87a8e3f260ff tempest-DeleteServersTestJSON-839781773 tempest-DeleteServersTestJSON-839781773-project] 10.222.0.64 "GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79" status: 404 len: 111 microversion: 2.1 time: 0.036233 Aug 03 13:00:55.850406 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 124/227] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:55 2022] GET /compute/v2.1/servers/20c576c6-074d-43df-b155-f95b3cd5bb79 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:00:56.671996 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-fc3434b1-cd95-455b-b523-d4a6322788c5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:56.671996 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-fc3434b1-cd95-455b-b523-d4a6322788c5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:56.682126 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fc3434b1-cd95-455b-b523-d4a6322788c5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:56.684106 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fc3434b1-cd95-455b-b523-d4a6322788c5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:56.691825 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fc3434b1-cd95-455b-b523-d4a6322788c5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:56.692720 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fc3434b1-cd95-455b-b523-d4a6322788c5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:56.949837 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-fc3434b1-cd95-455b-b523-d4a6322788c5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:56.966113 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-fc3434b1-cd95-455b-b523-d4a6322788c5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.294175 Aug 03 13:00:56.969407 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 104/228] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:56 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:57.991223 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-24f945fb-9ace-40e3-bd04-117ba260be74 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:57.991933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-24f945fb-9ace-40e3-bd04-117ba260be74 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:58.000859 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-24f945fb-9ace-40e3-bd04-117ba260be74 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:58.001337 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-24f945fb-9ace-40e3-bd04-117ba260be74 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:58.002081 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-24f945fb-9ace-40e3-bd04-117ba260be74 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:58.002514 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-24f945fb-9ace-40e3-bd04-117ba260be74 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:58.231986 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-24f945fb-9ace-40e3-bd04-117ba260be74 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:58.241410 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-24f945fb-9ace-40e3-bd04-117ba260be74 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.255337 Aug 03 13:00:58.243842 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 125/229] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:57 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:00:59.264243 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-72390b0b-39b7-492c-aac0-b53fa7ee16b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:00:59.264878 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-72390b0b-39b7-492c-aac0-b53fa7ee16b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:00:59.276355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-72390b0b-39b7-492c-aac0-b53fa7ee16b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:59.276814 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-72390b0b-39b7-492c-aac0-b53fa7ee16b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:59.284422 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-72390b0b-39b7-492c-aac0-b53fa7ee16b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:00:59.294183 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-72390b0b-39b7-492c-aac0-b53fa7ee16b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:00:59.612159 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-72390b0b-39b7-492c-aac0-b53fa7ee16b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:00:59.624107 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-72390b0b-39b7-492c-aac0-b53fa7ee16b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.365099 Aug 03 13:00:59.628964 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 105/230] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:00:59 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:00.652717 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-1b5965f5-7372-4ccf-a9d7-ba45c9f18b54 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:00.653323 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-1b5965f5-7372-4ccf-a9d7-ba45c9f18b54 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:00.671318 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1b5965f5-7372-4ccf-a9d7-ba45c9f18b54 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:00.672987 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1b5965f5-7372-4ccf-a9d7-ba45c9f18b54 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:00.673827 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1b5965f5-7372-4ccf-a9d7-ba45c9f18b54 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:00.674262 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1b5965f5-7372-4ccf-a9d7-ba45c9f18b54 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:01.183178 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-1b5965f5-7372-4ccf-a9d7-ba45c9f18b54 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:01.194461 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-1b5965f5-7372-4ccf-a9d7-ba45c9f18b54 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.546498 Aug 03 13:01:01.195429 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 126/231] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:00 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:02.218339 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-203171ef-e51b-4344-bd96-9e7d419049e4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:02.219771 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-203171ef-e51b-4344-bd96-9e7d419049e4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:02.233848 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-203171ef-e51b-4344-bd96-9e7d419049e4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:02.240528 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-203171ef-e51b-4344-bd96-9e7d419049e4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:02.241692 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-203171ef-e51b-4344-bd96-9e7d419049e4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:02.243486 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-203171ef-e51b-4344-bd96-9e7d419049e4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:02.438833 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-203171ef-e51b-4344-bd96-9e7d419049e4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:02.447670 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-203171ef-e51b-4344-bd96-9e7d419049e4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.233168 Aug 03 13:01:02.448245 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 106/232] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:02 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:03.477253 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-b55a5732-5a07-40f3-8e2d-f68544a70907 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:03.477253 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-b55a5732-5a07-40f3-8e2d-f68544a70907 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:03.485377 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b55a5732-5a07-40f3-8e2d-f68544a70907 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:03.486059 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b55a5732-5a07-40f3-8e2d-f68544a70907 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:03.487101 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b55a5732-5a07-40f3-8e2d-f68544a70907 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:03.487731 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b55a5732-5a07-40f3-8e2d-f68544a70907 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:04.001597 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b55a5732-5a07-40f3-8e2d-f68544a70907 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:04.011152 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-b55a5732-5a07-40f3-8e2d-f68544a70907 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.544987 Aug 03 13:01:04.025303 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 127/233] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:03 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:04.473099 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-50f848aa-6da6-4b00-bc48-3e6d50f7acd5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-853359066", "imageRef": "c0aabcc0-d4af-4f0e-b8a5-d140344fce1f", "flavorRef": "452", "networks": [{"uuid": "f748a05c-8485-47d8-b9fc-d817c3b8bab2"}]}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:01:04.582326 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.network.neutron [None req-50f848aa-6da6-4b00-bc48-3e6d50f7acd5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] validate_networks() for [('f748a05c-8485-47d8-b9fc-d817c3b8bab2', None, None, None, None, None)] {{(pid=119410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 13:01:05.041330 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-4dc7a180-eb43-4281-afff-1bd1cf55a292 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:05.041330 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-4dc7a180-eb43-4281-afff-1bd1cf55a292 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:05.050042 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4dc7a180-eb43-4281-afff-1bd1cf55a292 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:05.050488 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4dc7a180-eb43-4281-afff-1bd1cf55a292 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:05.051296 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4dc7a180-eb43-4281-afff-1bd1cf55a292 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:05.051729 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4dc7a180-eb43-4281-afff-1bd1cf55a292 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:05.088865 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=100 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:05.607741 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-50f848aa-6da6-4b00-bc48-3e6d50f7acd5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Flavor limits 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 13:01:05.608787 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-50f848aa-6da6-4b00-bc48-3e6d50f7acd5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Image limits 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 13:01:05.609243 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-50f848aa-6da6-4b00-bc48-3e6d50f7acd5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Flavor pref 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 13:01:05.609645 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-50f848aa-6da6-4b00-bc48-3e6d50f7acd5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Image pref 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 13:01:05.610050 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-50f848aa-6da6-4b00-bc48-3e6d50f7acd5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 13:01:05.621116 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-50f848aa-6da6-4b00-bc48-3e6d50f7acd5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:05.621784 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-50f848aa-6da6-4b00-bc48-3e6d50f7acd5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:05.622725 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-50f848aa-6da6-4b00-bc48-3e6d50f7acd5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:05.623532 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-50f848aa-6da6-4b00-bc48-3e6d50f7acd5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:05.645554 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.quota [None req-50f848aa-6da6-4b00-bc48-3e6d50f7acd5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Getting quotas for project ef1e829edd5a4a5f8c5133cb5e37c284. Resources: {'instances', 'ram', 'cores'} {{(pid=119410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 13:01:05.651188 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.quota [None req-50f848aa-6da6-4b00-bc48-3e6d50f7acd5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Getting quotas for user 79fd9e0292fb4ebab755519ecc20235e and project ef1e829edd5a4a5f8c5133cb5e37c284. Resources: {'instances', 'ram', 'cores'} {{(pid=119410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 13:01:05.655899 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-4dc7a180-eb43-4281-afff-1bd1cf55a292 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:05.663942 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-50f848aa-6da6-4b00-bc48-3e6d50f7acd5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Going to run 1 instances... {{(pid=119410) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 13:01:05.666831 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-50f848aa-6da6-4b00-bc48-3e6d50f7acd5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0aabcc0-d4af-4f0e-b8a5-d140344fce1f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 13:01:05.670532 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-4dc7a180-eb43-4281-afff-1bd1cf55a292 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.634330 Aug 03 13:01:05.673119 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 128/234] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:05 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:05.832490 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-50f848aa-6da6-4b00-bc48-3e6d50f7acd5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.363771 Aug 03 13:01:05.837903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 107/235] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 3 13:01:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 13:01:05.849333 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-3b5eea7e-2016-4d75-ba00-8e06b194496d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:05.850198 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-3b5eea7e-2016-4d75-ba00-8e06b194496d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:05.933734 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-3b5eea7e-2016-4d75-ba00-8e06b194496d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:05.942759 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-3b5eea7e-2016-4d75-ba00-8e06b194496d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1213 microversion: 2.1 time: 0.098902 Aug 03 13:01:05.943725 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 129/236] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:05 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1213 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:06.694704 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-5640b3ca-b568-4e47-9099-6adefe6540e3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:06.695475 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-5640b3ca-b568-4e47-9099-6adefe6540e3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:06.723079 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:06.725944 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5640b3ca-b568-4e47-9099-6adefe6540e3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:06.733281 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5640b3ca-b568-4e47-9099-6adefe6540e3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:06.734720 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5640b3ca-b568-4e47-9099-6adefe6540e3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:06.751413 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5640b3ca-b568-4e47-9099-6adefe6540e3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:06.965552 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-6b9bf26f-86b3-4da8-8121-be24cbdf5b1f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:06.966321 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-6b9bf26f-86b3-4da8-8121-be24cbdf5b1f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:07.072178 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-5640b3ca-b568-4e47-9099-6adefe6540e3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:07.074570 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-6b9bf26f-86b3-4da8-8121-be24cbdf5b1f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:07.081237 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-5640b3ca-b568-4e47-9099-6adefe6540e3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.391206 Aug 03 13:01:07.081888 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 108/237] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:06 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:07.095442 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-6b9bf26f-86b3-4da8-8121-be24cbdf5b1f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1213 microversion: 2.1 time: 0.121752 Aug 03 13:01:07.095442 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 130/238] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:06 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1213 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:01:08.104230 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-88dcfa27-d733-4f6a-bcab-19f03ddc5a41 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:08.104914 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-88dcfa27-d733-4f6a-bcab-19f03ddc5a41 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:08.108592 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-997ab6d8-38fd-48d4-9c0d-76d91f84ac64 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:08.109388 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-997ab6d8-38fd-48d4-9c0d-76d91f84ac64 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:08.111269 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-88dcfa27-d733-4f6a-bcab-19f03ddc5a41 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:08.111807 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-88dcfa27-d733-4f6a-bcab-19f03ddc5a41 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:08.112644 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-88dcfa27-d733-4f6a-bcab-19f03ddc5a41 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:08.113236 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-88dcfa27-d733-4f6a-bcab-19f03ddc5a41 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:08.116475 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-997ab6d8-38fd-48d4-9c0d-76d91f84ac64 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:08.126381 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-997ab6d8-38fd-48d4-9c0d-76d91f84ac64 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:08.126381 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-997ab6d8-38fd-48d4-9c0d-76d91f84ac64 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:08.126381 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-997ab6d8-38fd-48d4-9c0d-76d91f84ac64 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:08.267995 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-997ab6d8-38fd-48d4-9c0d-76d91f84ac64 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:08.287908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-997ab6d8-38fd-48d4-9c0d-76d91f84ac64 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1217 microversion: 2.1 time: 0.177185 Aug 03 13:01:08.288911 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 109/239] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:08 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1217 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:08.375675 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-88dcfa27-d733-4f6a-bcab-19f03ddc5a41 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:08.384462 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-88dcfa27-d733-4f6a-bcab-19f03ddc5a41 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1521 microversion: 2.1 time: 0.284405 Aug 03 13:01:08.385196 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 131/240] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:08 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:09.308815 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-491609fc-bcb1-49d2-b15a-cca7a3ea13f2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:09.311541 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-491609fc-bcb1-49d2-b15a-cca7a3ea13f2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:09.326844 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-491609fc-bcb1-49d2-b15a-cca7a3ea13f2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:09.327291 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-491609fc-bcb1-49d2-b15a-cca7a3ea13f2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:09.328339 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-491609fc-bcb1-49d2-b15a-cca7a3ea13f2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:09.328881 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-491609fc-bcb1-49d2-b15a-cca7a3ea13f2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:09.405402 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-a39a32fd-a307-41dd-90a6-435ba8c3d2ad tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:09.408581 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-a39a32fd-a307-41dd-90a6-435ba8c3d2ad tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:09.416868 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a39a32fd-a307-41dd-90a6-435ba8c3d2ad tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:09.417315 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a39a32fd-a307-41dd-90a6-435ba8c3d2ad tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:09.418081 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a39a32fd-a307-41dd-90a6-435ba8c3d2ad tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:09.418510 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a39a32fd-a307-41dd-90a6-435ba8c3d2ad tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:09.472159 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-491609fc-bcb1-49d2-b15a-cca7a3ea13f2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:09.481698 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-491609fc-bcb1-49d2-b15a-cca7a3ea13f2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1273 microversion: 2.1 time: 0.176790 Aug 03 13:01:09.484879 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 110/241] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:09 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1273 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:01:09.633593 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-a39a32fd-a307-41dd-90a6-435ba8c3d2ad tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:09.645050 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-a39a32fd-a307-41dd-90a6-435ba8c3d2ad tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1501 microversion: 2.1 time: 0.242871 Aug 03 13:01:09.646316 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 132/242] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:09 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1501 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:01:09.670457 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-52a18f16-fcfb-48c6-bbc9-45456cec4ff7 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:09.671029 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-52a18f16-fcfb-48c6-bbc9-45456cec4ff7 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:09.701235 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-52a18f16-fcfb-48c6-bbc9-45456cec4ff7 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:09.705425 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-52a18f16-fcfb-48c6-bbc9-45456cec4ff7 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:09.709515 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-52a18f16-fcfb-48c6-bbc9-45456cec4ff7 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:09.711336 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-52a18f16-fcfb-48c6-bbc9-45456cec4ff7 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:09.908120 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-52a18f16-fcfb-48c6-bbc9-45456cec4ff7 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:09.923631 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-52a18f16-fcfb-48c6-bbc9-45456cec4ff7 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1515 microversion: 2.1 time: 0.257552 Aug 03 13:01:09.939246 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 111/243] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:09 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1515 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:10.506449 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-8d86f43f-6d29-475c-8fd1-7e1a98724622 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:10.507176 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-8d86f43f-6d29-475c-8fd1-7e1a98724622 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:10.521083 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8d86f43f-6d29-475c-8fd1-7e1a98724622 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:10.521985 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8d86f43f-6d29-475c-8fd1-7e1a98724622 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:10.525332 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8d86f43f-6d29-475c-8fd1-7e1a98724622 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:10.526443 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8d86f43f-6d29-475c-8fd1-7e1a98724622 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:10.769965 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-8d86f43f-6d29-475c-8fd1-7e1a98724622 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:10.805174 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-8d86f43f-6d29-475c-8fd1-7e1a98724622 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.302653 Aug 03 13:01:10.806135 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 133/244] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:10 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:11.881861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-57fe3238-9e38-4a9c-99e2-4224bbb3eefe tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:11.882467 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-57fe3238-9e38-4a9c-99e2-4224bbb3eefe tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:11.891670 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-57fe3238-9e38-4a9c-99e2-4224bbb3eefe tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:11.892119 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-57fe3238-9e38-4a9c-99e2-4224bbb3eefe tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:11.892868 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-57fe3238-9e38-4a9c-99e2-4224bbb3eefe tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:11.893298 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-57fe3238-9e38-4a9c-99e2-4224bbb3eefe tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:12.030841 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-57fe3238-9e38-4a9c-99e2-4224bbb3eefe tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:12.038463 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-57fe3238-9e38-4a9c-99e2-4224bbb3eefe tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.160982 Aug 03 13:01:12.039069 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 112/245] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:11 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:12.077578 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-fb0e195b-92ce-43be-bb84-67aedd7b26e2 req-7e6c27bb-9323-4943-8d66-ee2be09baabb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fbd50d5-080f-4c14-9818-ffc2af5956d0", "tag": "e45249a4-bda3-4953-980d-920f4eafb8c3"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:01:12.095080 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-fb0e195b-92ce-43be-bb84-67aedd7b26e2 req-7e6c27bb-9323-4943-8d66-ee2be09baabb service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:12.099293 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-fb0e195b-92ce-43be-bb84-67aedd7b26e2 req-7e6c27bb-9323-4943-8d66-ee2be09baabb service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:12.119834 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-fb0e195b-92ce-43be-bb84-67aedd7b26e2 req-7e6c27bb-9323-4943-8d66-ee2be09baabb service nova] Creating event network-changed:e45249a4-bda3-4953-980d-920f4eafb8c3 for instance 8fbd50d5-080f-4c14-9818-ffc2af5956d0 on hv-cinder-85083 Aug 03 13:01:12.127920 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-fb0e195b-92ce-43be-bb84-67aedd7b26e2 req-7e6c27bb-9323-4943-8d66-ee2be09baabb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053982 Aug 03 13:01:12.132330 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 134/246] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:01:12.931814 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-51a260e0-1fea-40a9-b388-a7e3265c5712 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:01:12.934102 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-51a260e0-1fea-40a9-b388-a7e3265c5712 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:12.941435 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-51a260e0-1fea-40a9-b388-a7e3265c5712 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:12.941823 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-51a260e0-1fea-40a9-b388-a7e3265c5712 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:12.943378 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-51a260e0-1fea-40a9-b388-a7e3265c5712 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:12.943808 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-51a260e0-1fea-40a9-b388-a7e3265c5712 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:12.971844 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-51a260e0-1fea-40a9-b388-a7e3265c5712 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lazy-loading 'flavor' on Instance uuid b39c466e-0f7f-48d9-accb-da8ecd932142 {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:01:13.030136 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-2c1dc8b2-62f8-4aaa-9dfd-a13735313e6f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Action: 'create', calling method: .version_select at 0x7fe6d859f3a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2027171876", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOW8MJR6HtGyWDF3rHHcQ/5hkniiZAIcXbobX5u0rrPF9eIsXVkOlf/j20iPrgLpwCfK7sfUozGFkUMn6lr5WEOhTwCtNS+bIBBLyZ8T3Wq2vGZWEv9p2MlMmpqSaFXRrQ=="}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:01:13.050654 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-2c1dc8b2-62f8-4aaa-9dfd-a13735313e6f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Getting quotas for project e62db2c6c7d846ff807ac67c8d8d715e. Resources: {'key_pairs'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 13:01:13.057207 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-2c1dc8b2-62f8-4aaa-9dfd-a13735313e6f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Getting quotas for user 8ab708da71f04d2ab83f3f438a8d49d0 and project e62db2c6c7d846ff807ac67c8d8d715e. Resources: {'key_pairs'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 13:01:13.259026 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-2c1dc8b2-62f8-4aaa-9dfd-a13735313e6f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.233578 Aug 03 13:01:13.270454 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 135/247] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Aug 3 13:01:13 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:01:13.270454 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-9567f523-f273-4726-9873-1818304ccdd5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:13.270454 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-9567f523-f273-4726-9873-1818304ccdd5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:13.281352 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9567f523-f273-4726-9873-1818304ccdd5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:13.283037 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9567f523-f273-4726-9873-1818304ccdd5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:13.284104 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9567f523-f273-4726-9873-1818304ccdd5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:13.284733 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9567f523-f273-4726-9873-1818304ccdd5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:13.390243 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-51a260e0-1fea-40a9-b388-a7e3265c5712 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "POST /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142/action" status: 200 len: 32 microversion: 2.1 time: 0.462252 Aug 03 13:01:13.390927 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 113/248] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Aug 3 13:01:12 2022] POST /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142/action => generated 32 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 13:01:13.403515 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-90014b4d-39ec-4be1-b395-a2edea2f5879 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1324464743", "imageRef": "8ea1fc94-3357-4d2b-8a09-ad169c361588", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2027171876", "networks": [{"uuid": "28eb75fc-2b5d-4e87-99ef-4fc09c213528"}]}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:01:13.486907 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-9567f523-f273-4726-9873-1818304ccdd5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:13.487247 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.network.neutron [None req-90014b4d-39ec-4be1-b395-a2edea2f5879 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] validate_networks() for [('28eb75fc-2b5d-4e87-99ef-4fc09c213528', None, None, None, None, None)] {{(pid=119410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 13:01:13.493578 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-9567f523-f273-4726-9873-1818304ccdd5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.232654 Aug 03 13:01:13.494153 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 136/249] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:13 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:13.511888 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-297bf573-6aa4-4374-a8e1-6da195a24b84 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:13.514058 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-297bf573-6aa4-4374-a8e1-6da195a24b84 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:13.519184 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-297bf573-6aa4-4374-a8e1-6da195a24b84 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:13.519634 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-297bf573-6aa4-4374-a8e1-6da195a24b84 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:13.520675 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-297bf573-6aa4-4374-a8e1-6da195a24b84 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:13.521223 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-297bf573-6aa4-4374-a8e1-6da195a24b84 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:13.747304 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-297bf573-6aa4-4374-a8e1-6da195a24b84 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:13.756902 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-297bf573-6aa4-4374-a8e1-6da195a24b84 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.261662 Aug 03 13:01:13.757786 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 137/250] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:13 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:14.032709 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-90014b4d-39ec-4be1-b395-a2edea2f5879 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Flavor limits 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 13:01:14.033192 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-90014b4d-39ec-4be1-b395-a2edea2f5879 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Image limits 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 13:01:14.033589 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-90014b4d-39ec-4be1-b395-a2edea2f5879 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Flavor pref 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 13:01:14.033994 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-90014b4d-39ec-4be1-b395-a2edea2f5879 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Image pref 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 13:01:14.034402 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-90014b4d-39ec-4be1-b395-a2edea2f5879 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 13:01:14.043791 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-90014b4d-39ec-4be1-b395-a2edea2f5879 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:14.044317 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-90014b4d-39ec-4be1-b395-a2edea2f5879 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:14.045120 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-90014b4d-39ec-4be1-b395-a2edea2f5879 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:14.045557 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-90014b4d-39ec-4be1-b395-a2edea2f5879 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:14.063630 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.quota [None req-90014b4d-39ec-4be1-b395-a2edea2f5879 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Getting quotas for project e62db2c6c7d846ff807ac67c8d8d715e. Resources: {'instances', 'ram', 'cores'} {{(pid=119410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 13:01:14.068462 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.quota [None req-90014b4d-39ec-4be1-b395-a2edea2f5879 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Getting quotas for user 8ab708da71f04d2ab83f3f438a8d49d0 and project e62db2c6c7d846ff807ac67c8d8d715e. Resources: {'instances', 'ram', 'cores'} {{(pid=119410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 13:01:14.080103 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-90014b4d-39ec-4be1-b395-a2edea2f5879 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Going to run 1 instances... {{(pid=119410) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 13:01:14.083029 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-90014b4d-39ec-4be1-b395-a2edea2f5879 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ea1fc94-3357-4d2b-8a09-ad169c361588',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 13:01:14.284149 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-90014b4d-39ec-4be1-b395-a2edea2f5879 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.892089 Aug 03 13:01:14.284797 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 114/251] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 3 13:01:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 13:01:14.296045 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-efb856b3-146f-464d-b909-871d2f3530db tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:14.297006 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-efb856b3-146f-464d-b909-871d2f3530db tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:14.380674 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-efb856b3-146f-464d-b909-871d2f3530db tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:14.387535 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-efb856b3-146f-464d-b909-871d2f3530db tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1259 microversion: 2.1 time: 0.095126 Aug 03 13:01:14.388102 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 138/252] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:14 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1259 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:14.513751 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-4be44237-85bc-4832-a78e-7db9606043cf tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:14.514359 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-4be44237-85bc-4832-a78e-7db9606043cf tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:14.521219 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4be44237-85bc-4832-a78e-7db9606043cf tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:14.521663 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4be44237-85bc-4832-a78e-7db9606043cf tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:14.522416 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4be44237-85bc-4832-a78e-7db9606043cf tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:14.522884 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4be44237-85bc-4832-a78e-7db9606043cf tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:14.673798 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-4be44237-85bc-4832-a78e-7db9606043cf tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:14.676134 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:14.682132 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-4be44237-85bc-4832-a78e-7db9606043cf tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.172225 Aug 03 13:01:14.682801 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 115/253] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:14 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:01:14.778596 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-9731ee22-38ea-454b-8213-4b71cc022a76 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:14.779228 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-9731ee22-38ea-454b-8213-4b71cc022a76 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:14.785502 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9731ee22-38ea-454b-8213-4b71cc022a76 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:14.786499 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9731ee22-38ea-454b-8213-4b71cc022a76 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:14.787281 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9731ee22-38ea-454b-8213-4b71cc022a76 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:14.787710 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9731ee22-38ea-454b-8213-4b71cc022a76 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:14.929981 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-9731ee22-38ea-454b-8213-4b71cc022a76 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:14.937513 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-9731ee22-38ea-454b-8213-4b71cc022a76 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.162694 Aug 03 13:01:14.938078 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 139/254] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:14 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:15.410632 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-8753c6bb-e735-4bc5-820d-7dedb53d1ff8 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:15.410632 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-8753c6bb-e735-4bc5-820d-7dedb53d1ff8 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:15.474631 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-8753c6bb-e735-4bc5-820d-7dedb53d1ff8 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:15.481364 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-8753c6bb-e735-4bc5-820d-7dedb53d1ff8 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1259 microversion: 2.1 time: 0.076642 Aug 03 13:01:15.481941 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 116/255] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:15 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1259 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:15.703365 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-1713c5fb-e044-403c-acad-6f25a9273070 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:15.703976 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-1713c5fb-e044-403c-acad-6f25a9273070 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:15.710098 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1713c5fb-e044-403c-acad-6f25a9273070 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:15.710575 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1713c5fb-e044-403c-acad-6f25a9273070 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:15.711540 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1713c5fb-e044-403c-acad-6f25a9273070 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:15.715323 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1713c5fb-e044-403c-acad-6f25a9273070 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:15.854906 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-1713c5fb-e044-403c-acad-6f25a9273070 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:15.862821 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-1713c5fb-e044-403c-acad-6f25a9273070 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.163273 Aug 03 13:01:15.863404 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 140/256] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:15 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:15.960358 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-ffbd79d4-d934-497a-8bf1-55d687ad910a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:15.960965 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-ffbd79d4-d934-497a-8bf1-55d687ad910a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:15.968030 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ffbd79d4-d934-497a-8bf1-55d687ad910a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:15.968477 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ffbd79d4-d934-497a-8bf1-55d687ad910a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:15.969294 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ffbd79d4-d934-497a-8bf1-55d687ad910a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:15.969905 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ffbd79d4-d934-497a-8bf1-55d687ad910a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:16.115780 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ffbd79d4-d934-497a-8bf1-55d687ad910a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:16.126807 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-ffbd79d4-d934-497a-8bf1-55d687ad910a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.171006 Aug 03 13:01:16.128907 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 117/257] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:15 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:16.502418 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-15fd0dc3-2be2-4356-9e82-e275c068bc79 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:16.503081 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-15fd0dc3-2be2-4356-9e82-e275c068bc79 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:16.510779 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-15fd0dc3-2be2-4356-9e82-e275c068bc79 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:16.510950 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-15fd0dc3-2be2-4356-9e82-e275c068bc79 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:16.516298 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-15fd0dc3-2be2-4356-9e82-e275c068bc79 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:16.516298 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-15fd0dc3-2be2-4356-9e82-e275c068bc79 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:16.577297 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-15fd0dc3-2be2-4356-9e82-e275c068bc79 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:16.585339 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-15fd0dc3-2be2-4356-9e82-e275c068bc79 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1263 microversion: 2.1 time: 0.086673 Aug 03 13:01:16.586097 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 141/258] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:16 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1263 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:16.884572 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-5e6ba02a-3e15-4420-8bd5-c0e69047fa4a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:16.885183 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-5e6ba02a-3e15-4420-8bd5-c0e69047fa4a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:16.891804 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5e6ba02a-3e15-4420-8bd5-c0e69047fa4a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:16.892247 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5e6ba02a-3e15-4420-8bd5-c0e69047fa4a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:16.893023 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5e6ba02a-3e15-4420-8bd5-c0e69047fa4a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:16.893452 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5e6ba02a-3e15-4420-8bd5-c0e69047fa4a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:17.027121 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-5e6ba02a-3e15-4420-8bd5-c0e69047fa4a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:17.035195 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-5e6ba02a-3e15-4420-8bd5-c0e69047fa4a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.154404 Aug 03 13:01:17.036187 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 118/259] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:16 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:17.148527 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-b29e3e6e-d1dd-407a-b17c-fce657b756a5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:17.149444 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-b29e3e6e-d1dd-407a-b17c-fce657b756a5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:17.155800 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b29e3e6e-d1dd-407a-b17c-fce657b756a5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:17.156672 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b29e3e6e-d1dd-407a-b17c-fce657b756a5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:17.258959 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b29e3e6e-d1dd-407a-b17c-fce657b756a5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:17.258959 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b29e3e6e-d1dd-407a-b17c-fce657b756a5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:17.302089 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b29e3e6e-d1dd-407a-b17c-fce657b756a5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:17.310453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-b29e3e6e-d1dd-407a-b17c-fce657b756a5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.166414 Aug 03 13:01:17.320896 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 142/260] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:17 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:17.605578 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-eb5aa024-095a-48da-89b6-a039f333b833 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:17.606199 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-eb5aa024-095a-48da-89b6-a039f333b833 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:17.612294 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-eb5aa024-095a-48da-89b6-a039f333b833 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:17.612838 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-eb5aa024-095a-48da-89b6-a039f333b833 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:17.613954 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-eb5aa024-095a-48da-89b6-a039f333b833 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:17.614551 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-eb5aa024-095a-48da-89b6-a039f333b833 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:17.679850 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-eb5aa024-095a-48da-89b6-a039f333b833 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:17.687619 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-eb5aa024-095a-48da-89b6-a039f333b833 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1263 microversion: 2.1 time: 0.086195 Aug 03 13:01:17.688192 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 119/261] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:17 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1263 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:18.057269 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-93061a90-39e2-41f0-848a-3c0aa55713fd tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:18.058414 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-93061a90-39e2-41f0-848a-3c0aa55713fd tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:18.065972 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-93061a90-39e2-41f0-848a-3c0aa55713fd tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:18.075382 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-93061a90-39e2-41f0-848a-3c0aa55713fd tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:18.075382 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-93061a90-39e2-41f0-848a-3c0aa55713fd tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:18.075382 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-93061a90-39e2-41f0-848a-3c0aa55713fd tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:18.222223 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-93061a90-39e2-41f0-848a-3c0aa55713fd tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:18.229581 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-93061a90-39e2-41f0-848a-3c0aa55713fd tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.177824 Aug 03 13:01:18.238110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 143/262] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:18 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:18.332027 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-62c83e7a-5a0d-4676-b098-35528470fa66 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:18.332661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-62c83e7a-5a0d-4676-b098-35528470fa66 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:18.339282 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-62c83e7a-5a0d-4676-b098-35528470fa66 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:18.339739 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-62c83e7a-5a0d-4676-b098-35528470fa66 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:18.340627 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-62c83e7a-5a0d-4676-b098-35528470fa66 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:18.341064 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-62c83e7a-5a0d-4676-b098-35528470fa66 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:18.475041 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-62c83e7a-5a0d-4676-b098-35528470fa66 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:18.482432 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-62c83e7a-5a0d-4676-b098-35528470fa66 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.154385 Aug 03 13:01:18.483060 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 120/263] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:18 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:18.708369 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ad5e0001-c92a-4a45-9dc0-1d9badaee078 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:18.708979 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-ad5e0001-c92a-4a45-9dc0-1d9badaee078 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:18.715045 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ad5e0001-c92a-4a45-9dc0-1d9badaee078 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:18.715495 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ad5e0001-c92a-4a45-9dc0-1d9badaee078 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:18.716246 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ad5e0001-c92a-4a45-9dc0-1d9badaee078 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:18.716681 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ad5e0001-c92a-4a45-9dc0-1d9badaee078 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:18.783659 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ad5e0001-c92a-4a45-9dc0-1d9badaee078 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:18.791852 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-ad5e0001-c92a-4a45-9dc0-1d9badaee078 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1311 microversion: 2.1 time: 0.087334 Aug 03 13:01:18.792642 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 144/264] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:18 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1311 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:19.253137 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1e5160f7-a1c7-430f-a41d-0a4dc846915b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:19.253752 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-1e5160f7-a1c7-430f-a41d-0a4dc846915b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:19.263432 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1e5160f7-a1c7-430f-a41d-0a4dc846915b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:19.263432 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1e5160f7-a1c7-430f-a41d-0a4dc846915b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:19.264302 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1e5160f7-a1c7-430f-a41d-0a4dc846915b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:19.264796 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1e5160f7-a1c7-430f-a41d-0a4dc846915b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:19.434421 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-1e5160f7-a1c7-430f-a41d-0a4dc846915b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:19.448073 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-1e5160f7-a1c7-430f-a41d-0a4dc846915b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.199004 Aug 03 13:01:19.456721 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 121/265] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:19 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:19.503689 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-2c2b6f2b-509a-4d2c-a00a-7961aa5e81d8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:19.504840 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-2c2b6f2b-509a-4d2c-a00a-7961aa5e81d8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:19.511208 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2c2b6f2b-509a-4d2c-a00a-7961aa5e81d8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:19.511948 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2c2b6f2b-509a-4d2c-a00a-7961aa5e81d8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:19.512914 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2c2b6f2b-509a-4d2c-a00a-7961aa5e81d8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:19.513544 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2c2b6f2b-509a-4d2c-a00a-7961aa5e81d8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:19.672813 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-2c2b6f2b-509a-4d2c-a00a-7961aa5e81d8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:19.681380 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-2c2b6f2b-509a-4d2c-a00a-7961aa5e81d8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.181370 Aug 03 13:01:19.682651 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 145/266] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:19 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:19.813995 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-398f3664-208e-4a2b-b8b0-9dedd994e00f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:19.817570 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-398f3664-208e-4a2b-b8b0-9dedd994e00f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:19.830358 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-398f3664-208e-4a2b-b8b0-9dedd994e00f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:19.833397 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-398f3664-208e-4a2b-b8b0-9dedd994e00f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:19.835493 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-398f3664-208e-4a2b-b8b0-9dedd994e00f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:19.836198 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-398f3664-208e-4a2b-b8b0-9dedd994e00f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:20.063499 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-398f3664-208e-4a2b-b8b0-9dedd994e00f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:20.074222 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-398f3664-208e-4a2b-b8b0-9dedd994e00f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.264478 Aug 03 13:01:20.075114 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 122/267] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:19 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:20.472310 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-aaa01eaf-3351-4518-8c75-7e1074c98a0c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:20.473134 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-aaa01eaf-3351-4518-8c75-7e1074c98a0c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:20.480013 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-aaa01eaf-3351-4518-8c75-7e1074c98a0c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:20.480990 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-aaa01eaf-3351-4518-8c75-7e1074c98a0c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:20.482037 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-aaa01eaf-3351-4518-8c75-7e1074c98a0c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:20.482563 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-aaa01eaf-3351-4518-8c75-7e1074c98a0c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:20.709409 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d4d81eb2-2744-4106-b8a5-3c51b51e6e6a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:20.718402 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d4d81eb2-2744-4106-b8a5-3c51b51e6e6a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:20.722040 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-aaa01eaf-3351-4518-8c75-7e1074c98a0c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:20.734513 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-aaa01eaf-3351-4518-8c75-7e1074c98a0c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.263143 Aug 03 13:01:20.735256 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d4d81eb2-2744-4106-b8a5-3c51b51e6e6a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:20.735893 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 146/268] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:20 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:20.753453 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d4d81eb2-2744-4106-b8a5-3c51b51e6e6a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:20.755432 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d4d81eb2-2744-4106-b8a5-3c51b51e6e6a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:20.756046 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d4d81eb2-2744-4106-b8a5-3c51b51e6e6a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:21.057507 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d4d81eb2-2744-4106-b8a5-3c51b51e6e6a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:21.070152 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d4d81eb2-2744-4106-b8a5-3c51b51e6e6a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.368667 Aug 03 13:01:21.087192 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 123/269] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:20 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:21.103640 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-722849e9-5069-4b37-ab63-fffe4e65cdfd tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:21.106122 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-722849e9-5069-4b37-ab63-fffe4e65cdfd tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:21.116706 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-722849e9-5069-4b37-ab63-fffe4e65cdfd tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:21.120527 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-722849e9-5069-4b37-ab63-fffe4e65cdfd tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:21.120527 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-722849e9-5069-4b37-ab63-fffe4e65cdfd tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:21.120527 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-722849e9-5069-4b37-ab63-fffe4e65cdfd tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:21.223727 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-3ab0397a-c1a1-45b5-b385-471f5a577def req-c69b7f9a-5125-4bde-9f4f-3106bc4539e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49e06db0-38af-484d-8cc3-40999cc5fb8a", "tag": "2afbe9eb-dc9f-4e11-aca2-d72192f28195"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:01:21.249969 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-3ab0397a-c1a1-45b5-b385-471f5a577def req-c69b7f9a-5125-4bde-9f4f-3106bc4539e9 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:21.250264 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-3ab0397a-c1a1-45b5-b385-471f5a577def req-c69b7f9a-5125-4bde-9f4f-3106bc4539e9 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:21.280694 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-3ab0397a-c1a1-45b5-b385-471f5a577def req-c69b7f9a-5125-4bde-9f4f-3106bc4539e9 service nova] Creating event network-changed:2afbe9eb-dc9f-4e11-aca2-d72192f28195 for instance 49e06db0-38af-484d-8cc3-40999cc5fb8a on hv-cinder-85083 Aug 03 13:01:21.289192 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-3ab0397a-c1a1-45b5-b385-471f5a577def req-c69b7f9a-5125-4bde-9f4f-3106bc4539e9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069908 Aug 03 13:01:21.290895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 124/270] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:01:21.317555 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-722849e9-5069-4b37-ab63-fffe4e65cdfd tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:21.329596 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-722849e9-5069-4b37-ab63-fffe4e65cdfd tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.232878 Aug 03 13:01:21.330552 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 147/271] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:21 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:21.761964 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-c7d7de69-994a-46ac-a26b-133620c85ae2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:21.763395 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-c7d7de69-994a-46ac-a26b-133620c85ae2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:21.770161 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c7d7de69-994a-46ac-a26b-133620c85ae2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:21.770645 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c7d7de69-994a-46ac-a26b-133620c85ae2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:21.771652 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c7d7de69-994a-46ac-a26b-133620c85ae2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:21.772088 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c7d7de69-994a-46ac-a26b-133620c85ae2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:21.917675 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c7d7de69-994a-46ac-a26b-133620c85ae2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:21.925593 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-c7d7de69-994a-46ac-a26b-133620c85ae2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.168356 Aug 03 13:01:21.926755 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 125/272] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:21 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:22.106524 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-5004293c-1cff-42dd-b774-338e44f91b82 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:22.107176 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-5004293c-1cff-42dd-b774-338e44f91b82 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:22.113576 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5004293c-1cff-42dd-b774-338e44f91b82 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:22.113961 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5004293c-1cff-42dd-b774-338e44f91b82 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:22.114890 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5004293c-1cff-42dd-b774-338e44f91b82 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:22.115381 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5004293c-1cff-42dd-b774-338e44f91b82 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:22.263143 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-5004293c-1cff-42dd-b774-338e44f91b82 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:22.271077 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-5004293c-1cff-42dd-b774-338e44f91b82 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.168496 Aug 03 13:01:22.271628 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 148/273] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:22 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:22.356907 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1092423d-ec68-4a44-9f2e-d288a64196b1 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:22.357965 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-1092423d-ec68-4a44-9f2e-d288a64196b1 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:22.364943 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1092423d-ec68-4a44-9f2e-d288a64196b1 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:22.365401 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1092423d-ec68-4a44-9f2e-d288a64196b1 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:22.366171 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1092423d-ec68-4a44-9f2e-d288a64196b1 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:22.366606 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1092423d-ec68-4a44-9f2e-d288a64196b1 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:22.526216 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-1092423d-ec68-4a44-9f2e-d288a64196b1 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:22.534485 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-1092423d-ec68-4a44-9f2e-d288a64196b1 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.181088 Aug 03 13:01:22.535620 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 126/274] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:22 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:22.956421 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-29088a53-3ef0-4cb0-b735-5208e8341b3a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:22.957211 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-29088a53-3ef0-4cb0-b735-5208e8341b3a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:22.963786 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-29088a53-3ef0-4cb0-b735-5208e8341b3a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:22.964234 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-29088a53-3ef0-4cb0-b735-5208e8341b3a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:22.965103 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-29088a53-3ef0-4cb0-b735-5208e8341b3a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:22.965584 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-29088a53-3ef0-4cb0-b735-5208e8341b3a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:22.985363 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=100 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:23.116686 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-29088a53-3ef0-4cb0-b735-5208e8341b3a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:23.128212 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-29088a53-3ef0-4cb0-b735-5208e8341b3a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.175636 Aug 03 13:01:23.128895 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 149/275] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:22 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:23.292490 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-bc321268-5052-4b04-be35-9513919a7c84 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:23.293139 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-bc321268-5052-4b04-be35-9513919a7c84 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:23.299861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bc321268-5052-4b04-be35-9513919a7c84 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:23.300400 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bc321268-5052-4b04-be35-9513919a7c84 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:23.301841 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bc321268-5052-4b04-be35-9513919a7c84 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:23.302274 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bc321268-5052-4b04-be35-9513919a7c84 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:23.444172 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-bc321268-5052-4b04-be35-9513919a7c84 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:23.451658 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-bc321268-5052-4b04-be35-9513919a7c84 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.163177 Aug 03 13:01:23.452235 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 127/276] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:23 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:23.558208 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-614eae0a-f4e6-48cb-a6b7-fb943a17fbd5 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:23.558753 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-614eae0a-f4e6-48cb-a6b7-fb943a17fbd5 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:23.565160 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-614eae0a-f4e6-48cb-a6b7-fb943a17fbd5 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:23.565893 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-614eae0a-f4e6-48cb-a6b7-fb943a17fbd5 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:23.566874 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-614eae0a-f4e6-48cb-a6b7-fb943a17fbd5 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:23.567450 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-614eae0a-f4e6-48cb-a6b7-fb943a17fbd5 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:23.709926 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-614eae0a-f4e6-48cb-a6b7-fb943a17fbd5 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:23.718765 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-614eae0a-f4e6-48cb-a6b7-fb943a17fbd5 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.164461 Aug 03 13:01:23.719334 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 150/277] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:23 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:24.149027 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-67d3a05d-ddbe-4aa7-a107-6b7d06cd760f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:24.149706 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-67d3a05d-ddbe-4aa7-a107-6b7d06cd760f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:24.152004 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=4 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:24.157681 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-67d3a05d-ddbe-4aa7-a107-6b7d06cd760f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:24.160891 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-67d3a05d-ddbe-4aa7-a107-6b7d06cd760f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:24.161526 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-67d3a05d-ddbe-4aa7-a107-6b7d06cd760f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:24.162003 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-67d3a05d-ddbe-4aa7-a107-6b7d06cd760f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:24.300975 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-67d3a05d-ddbe-4aa7-a107-6b7d06cd760f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:24.310191 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-67d3a05d-ddbe-4aa7-a107-6b7d06cd760f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.164795 Aug 03 13:01:24.310894 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 128/278] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:24 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:24.491154 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-f3a26d33-5f9c-4766-a6fc-bc3730d8fb6d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:24.491949 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-f3a26d33-5f9c-4766-a6fc-bc3730d8fb6d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:24.495007 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell0:SELECT=10 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:24.498807 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f3a26d33-5f9c-4766-a6fc-bc3730d8fb6d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:24.500144 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f3a26d33-5f9c-4766-a6fc-bc3730d8fb6d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:24.501133 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f3a26d33-5f9c-4766-a6fc-bc3730d8fb6d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:24.501583 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f3a26d33-5f9c-4766-a6fc-bc3730d8fb6d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:24.669345 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-f3a26d33-5f9c-4766-a6fc-bc3730d8fb6d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:24.677543 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-f3a26d33-5f9c-4766-a6fc-bc3730d8fb6d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.191764 Aug 03 13:01:24.678405 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 151/279] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:24 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:24.740698 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d7329d35-dfc1-47db-a280-8f0af2f9e66d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:24.741246 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d7329d35-dfc1-47db-a280-8f0af2f9e66d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:24.747337 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d7329d35-dfc1-47db-a280-8f0af2f9e66d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:24.747787 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d7329d35-dfc1-47db-a280-8f0af2f9e66d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:24.748547 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d7329d35-dfc1-47db-a280-8f0af2f9e66d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:24.749157 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d7329d35-dfc1-47db-a280-8f0af2f9e66d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:24.905076 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d7329d35-dfc1-47db-a280-8f0af2f9e66d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:24.913073 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d7329d35-dfc1-47db-a280-8f0af2f9e66d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.176438 Aug 03 13:01:24.913736 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 129/280] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:24 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:01:25.331311 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-473453c1-e77b-499c-89eb-1a306f9103f5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:25.331925 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-473453c1-e77b-499c-89eb-1a306f9103f5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:25.338575 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-473453c1-e77b-499c-89eb-1a306f9103f5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:25.339085 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-473453c1-e77b-499c-89eb-1a306f9103f5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:25.340576 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-473453c1-e77b-499c-89eb-1a306f9103f5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:25.340576 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-473453c1-e77b-499c-89eb-1a306f9103f5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:25.494595 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-473453c1-e77b-499c-89eb-1a306f9103f5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:25.504399 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-473453c1-e77b-499c-89eb-1a306f9103f5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.176795 Aug 03 13:01:25.505241 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 152/281] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:25 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:25.698955 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-14575516-42b3-4919-9fe2-b2cfddb927af tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:25.699661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-14575516-42b3-4919-9fe2-b2cfddb927af tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:25.701919 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=14 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:25.708032 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-14575516-42b3-4919-9fe2-b2cfddb927af tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:25.708557 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-14575516-42b3-4919-9fe2-b2cfddb927af tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:25.712983 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-14575516-42b3-4919-9fe2-b2cfddb927af tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:25.712983 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-14575516-42b3-4919-9fe2-b2cfddb927af tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:25.880501 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-14575516-42b3-4919-9fe2-b2cfddb927af tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:25.888735 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-14575516-42b3-4919-9fe2-b2cfddb927af tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.193653 Aug 03 13:01:25.889647 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 130/282] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:25 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:25.935451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-f7d4db96-c3a0-46e0-b3fc-c7b7a06acbb4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:25.936151 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-f7d4db96-c3a0-46e0-b3fc-c7b7a06acbb4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:25.943647 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f7d4db96-c3a0-46e0-b3fc-c7b7a06acbb4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:25.944417 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f7d4db96-c3a0-46e0-b3fc-c7b7a06acbb4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:25.945730 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f7d4db96-c3a0-46e0-b3fc-c7b7a06acbb4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:25.946547 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f7d4db96-c3a0-46e0-b3fc-c7b7a06acbb4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:26.097414 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-f7d4db96-c3a0-46e0-b3fc-c7b7a06acbb4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:26.105585 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-f7d4db96-c3a0-46e0-b3fc-c7b7a06acbb4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.173812 Aug 03 13:01:26.106080 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 153/283] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:25 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:26.528167 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-4075eb42-5aa4-46dc-a2cb-50b11dd3e24e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:26.528780 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-4075eb42-5aa4-46dc-a2cb-50b11dd3e24e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:26.536279 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4075eb42-5aa4-46dc-a2cb-50b11dd3e24e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:26.536818 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4075eb42-5aa4-46dc-a2cb-50b11dd3e24e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:26.537746 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4075eb42-5aa4-46dc-a2cb-50b11dd3e24e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:26.538285 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4075eb42-5aa4-46dc-a2cb-50b11dd3e24e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:26.861849 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-4075eb42-5aa4-46dc-a2cb-50b11dd3e24e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:26.871137 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-4075eb42-5aa4-46dc-a2cb-50b11dd3e24e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.348731 Aug 03 13:01:26.871928 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 131/284] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:26 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:26.911236 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-2afcc058-6124-4c34-a401-fc4b60845138 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:26.911847 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-2afcc058-6124-4c34-a401-fc4b60845138 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:26.917926 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2afcc058-6124-4c34-a401-fc4b60845138 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:26.919114 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2afcc058-6124-4c34-a401-fc4b60845138 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:26.920050 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2afcc058-6124-4c34-a401-fc4b60845138 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:26.920634 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2afcc058-6124-4c34-a401-fc4b60845138 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:27.071649 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-2afcc058-6124-4c34-a401-fc4b60845138 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:27.079259 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-2afcc058-6124-4c34-a401-fc4b60845138 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.172550 Aug 03 13:01:27.079826 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 154/285] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:26 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:27.128357 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-b23e5dde-4725-45ea-ac95-1cff6de17727 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:27.133354 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-b23e5dde-4725-45ea-ac95-1cff6de17727 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:27.139538 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b23e5dde-4725-45ea-ac95-1cff6de17727 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:27.145656 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b23e5dde-4725-45ea-ac95-1cff6de17727 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:27.146458 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b23e5dde-4725-45ea-ac95-1cff6de17727 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:27.146975 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b23e5dde-4725-45ea-ac95-1cff6de17727 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:27.292663 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-b23e5dde-4725-45ea-ac95-1cff6de17727 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:27.300366 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-b23e5dde-4725-45ea-ac95-1cff6de17727 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.176453 Aug 03 13:01:27.301381 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 132/286] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:27 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:01:27.892238 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-4daa1081-ca14-4338-a5ef-f0faa8024553 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:27.892857 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-4daa1081-ca14-4338-a5ef-f0faa8024553 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:27.907630 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4daa1081-ca14-4338-a5ef-f0faa8024553 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:27.908078 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4daa1081-ca14-4338-a5ef-f0faa8024553 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:27.908864 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4daa1081-ca14-4338-a5ef-f0faa8024553 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:27.909298 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4daa1081-ca14-4338-a5ef-f0faa8024553 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:28.073743 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-4daa1081-ca14-4338-a5ef-f0faa8024553 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:28.081643 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-4daa1081-ca14-4338-a5ef-f0faa8024553 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.193226 Aug 03 13:01:28.082896 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 155/287] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:27 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:01:28.100870 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-8ba4da39-7d28-4e50-8708-5bc3580cd2ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:28.101808 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-8ba4da39-7d28-4e50-8708-5bc3580cd2ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:28.108304 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8ba4da39-7d28-4e50-8708-5bc3580cd2ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:28.108877 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8ba4da39-7d28-4e50-8708-5bc3580cd2ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:28.109665 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8ba4da39-7d28-4e50-8708-5bc3580cd2ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:28.110094 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8ba4da39-7d28-4e50-8708-5bc3580cd2ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:28.266221 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-8ba4da39-7d28-4e50-8708-5bc3580cd2ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:28.274371 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-8ba4da39-7d28-4e50-8708-5bc3580cd2ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.177713 Aug 03 13:01:28.275170 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 133/288] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:28 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:28.321812 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-7e22f0d0-bc3d-4760-9133-a036bc716789 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:28.322427 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-7e22f0d0-bc3d-4760-9133-a036bc716789 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:28.325490 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:28.329192 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7e22f0d0-bc3d-4760-9133-a036bc716789 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:28.329635 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7e22f0d0-bc3d-4760-9133-a036bc716789 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:28.330403 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7e22f0d0-bc3d-4760-9133-a036bc716789 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:28.330863 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7e22f0d0-bc3d-4760-9133-a036bc716789 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:28.493596 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-7e22f0d0-bc3d-4760-9133-a036bc716789 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:28.501349 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-7e22f0d0-bc3d-4760-9133-a036bc716789 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.183336 Aug 03 13:01:28.501921 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 156/289] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:28 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:01:29.103614 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-7115ceab-834e-4f13-b7d0-5acf3190e945 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:29.106035 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-7115ceab-834e-4f13-b7d0-5acf3190e945 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:29.110671 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7115ceab-834e-4f13-b7d0-5acf3190e945 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:29.111141 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7115ceab-834e-4f13-b7d0-5acf3190e945 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:29.111893 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7115ceab-834e-4f13-b7d0-5acf3190e945 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:29.112325 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7115ceab-834e-4f13-b7d0-5acf3190e945 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:29.114837 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=100 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:29.243801 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-7115ceab-834e-4f13-b7d0-5acf3190e945 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:29.251218 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-7115ceab-834e-4f13-b7d0-5acf3190e945 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.151344 Aug 03 13:01:29.251789 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 134/290] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:29 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:29.295847 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ac82d5cc-aed4-4007-ad42-a9465ff25ddd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:29.296561 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-ac82d5cc-aed4-4007-ad42-a9465ff25ddd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:29.303422 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ac82d5cc-aed4-4007-ad42-a9465ff25ddd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:29.303872 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ac82d5cc-aed4-4007-ad42-a9465ff25ddd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:29.304634 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ac82d5cc-aed4-4007-ad42-a9465ff25ddd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:29.305065 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ac82d5cc-aed4-4007-ad42-a9465ff25ddd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:29.431727 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ac82d5cc-aed4-4007-ad42-a9465ff25ddd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:29.439162 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-ac82d5cc-aed4-4007-ad42-a9465ff25ddd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.147443 Aug 03 13:01:29.439721 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 157/291] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:29 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:29.521644 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-90cf7b04-b2af-4e03-99f9-7250ea4181dd tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:29.522244 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-90cf7b04-b2af-4e03-99f9-7250ea4181dd tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:29.528437 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-90cf7b04-b2af-4e03-99f9-7250ea4181dd tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:29.528877 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-90cf7b04-b2af-4e03-99f9-7250ea4181dd tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:29.529624 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-90cf7b04-b2af-4e03-99f9-7250ea4181dd tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:29.530048 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-90cf7b04-b2af-4e03-99f9-7250ea4181dd tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:29.658387 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-90cf7b04-b2af-4e03-99f9-7250ea4181dd tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:29.666510 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-90cf7b04-b2af-4e03-99f9-7250ea4181dd tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.149371 Aug 03 13:01:29.667105 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 135/292] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:29 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:30.271873 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-21d71e19-d260-45f1-87da-d8d1b90d5ec9 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:30.272475 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-21d71e19-d260-45f1-87da-d8d1b90d5ec9 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:30.278397 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-21d71e19-d260-45f1-87da-d8d1b90d5ec9 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:30.278865 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-21d71e19-d260-45f1-87da-d8d1b90d5ec9 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:30.279611 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-21d71e19-d260-45f1-87da-d8d1b90d5ec9 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:30.280034 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-21d71e19-d260-45f1-87da-d8d1b90d5ec9 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:30.405396 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-21d71e19-d260-45f1-87da-d8d1b90d5ec9 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:30.413116 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-21d71e19-d260-45f1-87da-d8d1b90d5ec9 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.145115 Aug 03 13:01:30.413677 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 158/293] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:30 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:30.459872 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-c823e293-a6f6-4de9-b53d-8710ad0ee55c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:30.460480 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-c823e293-a6f6-4de9-b53d-8710ad0ee55c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:30.467334 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c823e293-a6f6-4de9-b53d-8710ad0ee55c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:30.467785 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c823e293-a6f6-4de9-b53d-8710ad0ee55c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:30.468548 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c823e293-a6f6-4de9-b53d-8710ad0ee55c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:30.468990 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c823e293-a6f6-4de9-b53d-8710ad0ee55c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:30.612318 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c823e293-a6f6-4de9-b53d-8710ad0ee55c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:30.620481 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-c823e293-a6f6-4de9-b53d-8710ad0ee55c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.164576 Aug 03 13:01:30.621236 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 136/294] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:30 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:01:30.687236 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-26a9bc64-93be-4a45-a548-5c24b6cd019d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:30.687841 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-26a9bc64-93be-4a45-a548-5c24b6cd019d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:30.693878 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-26a9bc64-93be-4a45-a548-5c24b6cd019d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:30.694323 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-26a9bc64-93be-4a45-a548-5c24b6cd019d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:30.695101 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-26a9bc64-93be-4a45-a548-5c24b6cd019d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:30.695553 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-26a9bc64-93be-4a45-a548-5c24b6cd019d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:30.821462 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-26a9bc64-93be-4a45-a548-5c24b6cd019d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:30.828784 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-26a9bc64-93be-4a45-a548-5c24b6cd019d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.145394 Aug 03 13:01:30.829339 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 159/295] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:30 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:31.433279 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-54ef0c26-01ce-49ce-9b71-62e20a3a0ba7 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:31.434064 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-54ef0c26-01ce-49ce-9b71-62e20a3a0ba7 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:31.439959 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-54ef0c26-01ce-49ce-9b71-62e20a3a0ba7 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:31.440409 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-54ef0c26-01ce-49ce-9b71-62e20a3a0ba7 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:31.441756 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-54ef0c26-01ce-49ce-9b71-62e20a3a0ba7 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:31.442239 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-54ef0c26-01ce-49ce-9b71-62e20a3a0ba7 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:31.568205 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-54ef0c26-01ce-49ce-9b71-62e20a3a0ba7 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:31.575549 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-54ef0c26-01ce-49ce-9b71-62e20a3a0ba7 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.146119 Aug 03 13:01:31.576118 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 137/296] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:31 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:31.641089 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-f98591f6-946d-4259-bf33-78354e6e486f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:31.641688 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-f98591f6-946d-4259-bf33-78354e6e486f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:31.648156 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f98591f6-946d-4259-bf33-78354e6e486f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:31.648594 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f98591f6-946d-4259-bf33-78354e6e486f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:31.649335 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f98591f6-946d-4259-bf33-78354e6e486f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:31.649758 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f98591f6-946d-4259-bf33-78354e6e486f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:31.777478 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-f98591f6-946d-4259-bf33-78354e6e486f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:31.785017 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-f98591f6-946d-4259-bf33-78354e6e486f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.147691 Aug 03 13:01:31.785576 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 160/297] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:31 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:31.848692 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-75a76a00-fcce-43db-aac7-6bcc13024d62 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:31.849304 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-75a76a00-fcce-43db-aac7-6bcc13024d62 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:31.855350 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-75a76a00-fcce-43db-aac7-6bcc13024d62 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:31.855802 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-75a76a00-fcce-43db-aac7-6bcc13024d62 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:31.856560 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-75a76a00-fcce-43db-aac7-6bcc13024d62 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:31.856997 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-75a76a00-fcce-43db-aac7-6bcc13024d62 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:31.982939 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-75a76a00-fcce-43db-aac7-6bcc13024d62 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:31.990832 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-75a76a00-fcce-43db-aac7-6bcc13024d62 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.146049 Aug 03 13:01:31.991396 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 138/298] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:31 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:01:32.596586 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-14aae5ea-7bff-4a02-8ebf-31d1b0ff6410 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:32.597125 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-14aae5ea-7bff-4a02-8ebf-31d1b0ff6410 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:32.603671 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-14aae5ea-7bff-4a02-8ebf-31d1b0ff6410 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:32.604122 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-14aae5ea-7bff-4a02-8ebf-31d1b0ff6410 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:32.604877 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-14aae5ea-7bff-4a02-8ebf-31d1b0ff6410 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:32.605312 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-14aae5ea-7bff-4a02-8ebf-31d1b0ff6410 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:32.732299 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-14aae5ea-7bff-4a02-8ebf-31d1b0ff6410 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:32.739754 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-14aae5ea-7bff-4a02-8ebf-31d1b0ff6410 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.147125 Aug 03 13:01:32.740691 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 161/299] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:32 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:32.805088 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d14a29fb-6da9-4089-9990-c8ac7d6a0226 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:32.805728 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d14a29fb-6da9-4089-9990-c8ac7d6a0226 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:32.812270 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d14a29fb-6da9-4089-9990-c8ac7d6a0226 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:32.812723 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d14a29fb-6da9-4089-9990-c8ac7d6a0226 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:32.813492 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d14a29fb-6da9-4089-9990-c8ac7d6a0226 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:32.813908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d14a29fb-6da9-4089-9990-c8ac7d6a0226 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:32.939863 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d14a29fb-6da9-4089-9990-c8ac7d6a0226 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:32.948001 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d14a29fb-6da9-4089-9990-c8ac7d6a0226 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.146711 Aug 03 13:01:32.948571 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 139/300] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:32 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:33.011559 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-6aee782a-0da3-4002-9a6e-7b72e2187ec2 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:33.012272 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-6aee782a-0da3-4002-9a6e-7b72e2187ec2 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:33.018213 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6aee782a-0da3-4002-9a6e-7b72e2187ec2 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:33.018659 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6aee782a-0da3-4002-9a6e-7b72e2187ec2 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:33.020082 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6aee782a-0da3-4002-9a6e-7b72e2187ec2 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:33.020516 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6aee782a-0da3-4002-9a6e-7b72e2187ec2 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:33.147722 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-6aee782a-0da3-4002-9a6e-7b72e2187ec2 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:33.155339 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-6aee782a-0da3-4002-9a6e-7b72e2187ec2 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.147549 Aug 03 13:01:33.156226 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 162/301] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:33 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:33.760702 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-bf158c22-ca82-4c5a-b42f-3bcb6b66644a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:33.761231 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-bf158c22-ca82-4c5a-b42f-3bcb6b66644a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:33.767305 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bf158c22-ca82-4c5a-b42f-3bcb6b66644a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:33.767753 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bf158c22-ca82-4c5a-b42f-3bcb6b66644a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:33.768505 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bf158c22-ca82-4c5a-b42f-3bcb6b66644a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:33.768939 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bf158c22-ca82-4c5a-b42f-3bcb6b66644a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:33.893346 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-bf158c22-ca82-4c5a-b42f-3bcb6b66644a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:33.900815 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-bf158c22-ca82-4c5a-b42f-3bcb6b66644a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.144000 Aug 03 13:01:33.901376 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 140/302] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:33 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:33.969504 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-99d488e5-a67a-4404-806e-2ba6668b77b8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:33.970110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-99d488e5-a67a-4404-806e-2ba6668b77b8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:33.976869 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-99d488e5-a67a-4404-806e-2ba6668b77b8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:33.977312 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-99d488e5-a67a-4404-806e-2ba6668b77b8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:33.978061 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-99d488e5-a67a-4404-806e-2ba6668b77b8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:33.978491 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-99d488e5-a67a-4404-806e-2ba6668b77b8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:34.104587 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-99d488e5-a67a-4404-806e-2ba6668b77b8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:34.112021 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-99d488e5-a67a-4404-806e-2ba6668b77b8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.146633 Aug 03 13:01:34.112606 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 163/303] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:33 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:34.176385 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-3de99086-ac78-43f6-86e1-00a992bafdfb tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:34.177002 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-3de99086-ac78-43f6-86e1-00a992bafdfb tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:34.183042 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3de99086-ac78-43f6-86e1-00a992bafdfb tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:34.183497 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3de99086-ac78-43f6-86e1-00a992bafdfb tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:34.184256 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3de99086-ac78-43f6-86e1-00a992bafdfb tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:34.184694 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3de99086-ac78-43f6-86e1-00a992bafdfb tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:34.314290 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-3de99086-ac78-43f6-86e1-00a992bafdfb tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:34.322031 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-3de99086-ac78-43f6-86e1-00a992bafdfb tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.149492 Aug 03 13:01:34.322584 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 141/304] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:34 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:34.922468 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-96bd7d33-3289-4170-84f2-34a0d7297b7b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:34.923093 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-96bd7d33-3289-4170-84f2-34a0d7297b7b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:34.929654 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-96bd7d33-3289-4170-84f2-34a0d7297b7b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:34.930125 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-96bd7d33-3289-4170-84f2-34a0d7297b7b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:34.930918 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-96bd7d33-3289-4170-84f2-34a0d7297b7b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:34.931357 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-96bd7d33-3289-4170-84f2-34a0d7297b7b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:35.056285 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-96bd7d33-3289-4170-84f2-34a0d7297b7b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:35.063746 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-96bd7d33-3289-4170-84f2-34a0d7297b7b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.145157 Aug 03 13:01:35.064739 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 164/305] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:34 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:35.132883 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-994a7c02-aa0b-4f62-b242-13d7071da1e9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:35.133491 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-994a7c02-aa0b-4f62-b242-13d7071da1e9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:35.140225 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-994a7c02-aa0b-4f62-b242-13d7071da1e9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:35.140674 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-994a7c02-aa0b-4f62-b242-13d7071da1e9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:35.141432 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-994a7c02-aa0b-4f62-b242-13d7071da1e9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:35.141864 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-994a7c02-aa0b-4f62-b242-13d7071da1e9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:35.271365 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-994a7c02-aa0b-4f62-b242-13d7071da1e9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:35.278929 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-994a7c02-aa0b-4f62-b242-13d7071da1e9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.150241 Aug 03 13:01:35.282815 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 142/306] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:35 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:35.342528 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-419cfa26-9c9e-4363-8fc8-ada651fb3af0 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:35.343191 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-419cfa26-9c9e-4363-8fc8-ada651fb3af0 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:35.350481 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-419cfa26-9c9e-4363-8fc8-ada651fb3af0 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:35.350965 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-419cfa26-9c9e-4363-8fc8-ada651fb3af0 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:35.351728 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-419cfa26-9c9e-4363-8fc8-ada651fb3af0 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:35.352160 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-419cfa26-9c9e-4363-8fc8-ada651fb3af0 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:35.479503 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-419cfa26-9c9e-4363-8fc8-ada651fb3af0 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:35.487335 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-419cfa26-9c9e-4363-8fc8-ada651fb3af0 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.148496 Aug 03 13:01:35.491420 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 165/307] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:35 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:36.086123 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-eee10523-7c9d-4937-8d99-6faab436fbd3 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:36.086778 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-eee10523-7c9d-4937-8d99-6faab436fbd3 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:36.092987 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-eee10523-7c9d-4937-8d99-6faab436fbd3 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:36.093435 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-eee10523-7c9d-4937-8d99-6faab436fbd3 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:36.094195 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-eee10523-7c9d-4937-8d99-6faab436fbd3 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:36.094649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-eee10523-7c9d-4937-8d99-6faab436fbd3 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:36.221549 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-eee10523-7c9d-4937-8d99-6faab436fbd3 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:36.228918 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-eee10523-7c9d-4937-8d99-6faab436fbd3 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.147500 Aug 03 13:01:36.229484 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 143/308] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:36 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:36.301035 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-e5605e90-0a78-4784-a445-116b7dd28451 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:36.301630 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-e5605e90-0a78-4784-a445-116b7dd28451 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:36.307555 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e5605e90-0a78-4784-a445-116b7dd28451 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:36.307991 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e5605e90-0a78-4784-a445-116b7dd28451 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:36.308732 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e5605e90-0a78-4784-a445-116b7dd28451 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:36.309157 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e5605e90-0a78-4784-a445-116b7dd28451 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:36.313019 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=100 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:36.438449 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-e5605e90-0a78-4784-a445-116b7dd28451 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:36.446820 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-e5605e90-0a78-4784-a445-116b7dd28451 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.150028 Aug 03 13:01:36.447378 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 166/309] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:36 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:36.508570 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-49f9af0e-14b1-4b05-9f98-ccf7e07ceca2 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:36.509173 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-49f9af0e-14b1-4b05-9f98-ccf7e07ceca2 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:36.515188 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-49f9af0e-14b1-4b05-9f98-ccf7e07ceca2 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:36.515642 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-49f9af0e-14b1-4b05-9f98-ccf7e07ceca2 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:36.516395 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-49f9af0e-14b1-4b05-9f98-ccf7e07ceca2 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:36.516824 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-49f9af0e-14b1-4b05-9f98-ccf7e07ceca2 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:36.645315 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-49f9af0e-14b1-4b05-9f98-ccf7e07ceca2 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:36.652707 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-49f9af0e-14b1-4b05-9f98-ccf7e07ceca2 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.148009 Aug 03 13:01:36.653372 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 144/310] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:36 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:37.249606 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-24f8257f-59b8-4677-ac08-6165c02231eb tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:37.250216 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-24f8257f-59b8-4677-ac08-6165c02231eb tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:37.256204 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-24f8257f-59b8-4677-ac08-6165c02231eb tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:37.256652 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-24f8257f-59b8-4677-ac08-6165c02231eb tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:37.257407 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-24f8257f-59b8-4677-ac08-6165c02231eb tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:37.257853 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-24f8257f-59b8-4677-ac08-6165c02231eb tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:37.469280 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-b0cc3688-d60b-4f0e-9757-eb28b6bb8315 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:37.469894 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-b0cc3688-d60b-4f0e-9757-eb28b6bb8315 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:37.478623 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b0cc3688-d60b-4f0e-9757-eb28b6bb8315 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:37.479210 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b0cc3688-d60b-4f0e-9757-eb28b6bb8315 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:37.481563 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b0cc3688-d60b-4f0e-9757-eb28b6bb8315 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:37.482203 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b0cc3688-d60b-4f0e-9757-eb28b6bb8315 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:37.626764 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-24f8257f-59b8-4677-ac08-6165c02231eb tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:37.634658 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-24f8257f-59b8-4677-ac08-6165c02231eb tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.388829 Aug 03 13:01:37.635244 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 167/311] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:37 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:37.672147 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-b0cc3688-d60b-4f0e-9757-eb28b6bb8315 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:37.673214 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-db4055e3-814e-42d2-af95-17afbfff1178 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:37.673829 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-db4055e3-814e-42d2-af95-17afbfff1178 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:37.679691 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-b0cc3688-d60b-4f0e-9757-eb28b6bb8315 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.215794 Aug 03 13:01:37.679866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-db4055e3-814e-42d2-af95-17afbfff1178 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:37.680260 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 145/312] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:37 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:37.680361 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-db4055e3-814e-42d2-af95-17afbfff1178 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:37.681089 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-db4055e3-814e-42d2-af95-17afbfff1178 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:37.681521 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-db4055e3-814e-42d2-af95-17afbfff1178 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:37.807388 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-db4055e3-814e-42d2-af95-17afbfff1178 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:37.814595 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-db4055e3-814e-42d2-af95-17afbfff1178 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.145081 Aug 03 13:01:37.815194 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 168/313] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:37 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:38.655507 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-ba080262-b9c4-4cbf-8002-1830da4b5db6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:38.656372 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-ba080262-b9c4-4cbf-8002-1830da4b5db6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:38.662891 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ba080262-b9c4-4cbf-8002-1830da4b5db6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:38.663343 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ba080262-b9c4-4cbf-8002-1830da4b5db6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:38.664106 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ba080262-b9c4-4cbf-8002-1830da4b5db6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:38.664538 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ba080262-b9c4-4cbf-8002-1830da4b5db6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:38.700617 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-1973aef1-fcc6-42bb-a7ee-a17f11ec18c8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:38.701221 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-1973aef1-fcc6-42bb-a7ee-a17f11ec18c8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:38.707174 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1973aef1-fcc6-42bb-a7ee-a17f11ec18c8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:38.707612 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1973aef1-fcc6-42bb-a7ee-a17f11ec18c8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:38.708379 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1973aef1-fcc6-42bb-a7ee-a17f11ec18c8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:38.708807 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1973aef1-fcc6-42bb-a7ee-a17f11ec18c8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:38.844788 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ba080262-b9c4-4cbf-8002-1830da4b5db6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:38.852899 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-ba080262-b9c4-4cbf-8002-1830da4b5db6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.201256 Aug 03 13:01:38.853464 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 146/314] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:38 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:38.858200 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-3752829f-2435-49e3-abc9-cbf5693970ef tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:38.858829 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-3752829f-2435-49e3-abc9-cbf5693970ef tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:38.866299 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3752829f-2435-49e3-abc9-cbf5693970ef tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:38.866806 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3752829f-2435-49e3-abc9-cbf5693970ef tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:38.867570 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3752829f-2435-49e3-abc9-cbf5693970ef tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:38.868003 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3752829f-2435-49e3-abc9-cbf5693970ef tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:38.868446 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-1973aef1-fcc6-42bb-a7ee-a17f11ec18c8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:38.875901 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-1973aef1-fcc6-42bb-a7ee-a17f11ec18c8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.179142 Aug 03 13:01:38.876466 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 169/315] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:38 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:01:38.994979 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-3752829f-2435-49e3-abc9-cbf5693970ef tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:39.002343 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-3752829f-2435-49e3-abc9-cbf5693970ef tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.147712 Aug 03 13:01:39.002916 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 147/316] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:38 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:39.873746 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-145bc99a-f6f5-4eea-832f-74170e46f02f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:39.874429 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-145bc99a-f6f5-4eea-832f-74170e46f02f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:39.880639 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-90864bfa-22ee-4aa5-849e-3f6c716226d3 req-f3e5af8f-4318-4329-b4d5-1345783bf0a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fbd50d5-080f-4c14-9818-ffc2af5956d0", "name": "network-vif-plugged", "status": "completed", "tag": "e45249a4-bda3-4953-980d-920f4eafb8c3"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:01:39.881571 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-145bc99a-f6f5-4eea-832f-74170e46f02f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:39.882023 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-145bc99a-f6f5-4eea-832f-74170e46f02f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:39.882811 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-145bc99a-f6f5-4eea-832f-74170e46f02f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:39.883249 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-145bc99a-f6f5-4eea-832f-74170e46f02f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:39.903361 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:39.909887 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-90864bfa-22ee-4aa5-849e-3f6c716226d3 req-f3e5af8f-4318-4329-b4d5-1345783bf0a1 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:39.910356 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-90864bfa-22ee-4aa5-849e-3f6c716226d3 req-f3e5af8f-4318-4329-b4d5-1345783bf0a1 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:39.922726 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-90864bfa-22ee-4aa5-849e-3f6c716226d3 req-f3e5af8f-4318-4329-b4d5-1345783bf0a1 service nova] Creating event network-vif-plugged:e45249a4-bda3-4953-980d-920f4eafb8c3 for instance 8fbd50d5-080f-4c14-9818-ffc2af5956d0 on hv-cinder-85083 Aug 03 13:01:39.927736 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-90864bfa-22ee-4aa5-849e-3f6c716226d3 req-f3e5af8f-4318-4329-b4d5-1345783bf0a1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051731 Aug 03 13:01:39.928902 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 148/317] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:01:39.945767 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-b9300624-c333-466e-a5d2-9cd94ddba6a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:39.946469 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-b9300624-c333-466e-a5d2-9cd94ddba6a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:39.953188 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b9300624-c333-466e-a5d2-9cd94ddba6a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:39.953643 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b9300624-c333-466e-a5d2-9cd94ddba6a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:39.954411 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b9300624-c333-466e-a5d2-9cd94ddba6a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:39.955155 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b9300624-c333-466e-a5d2-9cd94ddba6a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:40.110955 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-145bc99a-f6f5-4eea-832f-74170e46f02f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:40.118882 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-145bc99a-f6f5-4eea-832f-74170e46f02f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.249294 Aug 03 13:01:40.119446 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 170/318] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:39 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:40.123826 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-89c1bb15-6789-464f-8052-f4f3e6880083 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:40.124615 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-89c1bb15-6789-464f-8052-f4f3e6880083 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:40.131202 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-89c1bb15-6789-464f-8052-f4f3e6880083 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:40.131653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-89c1bb15-6789-464f-8052-f4f3e6880083 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:40.133134 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-89c1bb15-6789-464f-8052-f4f3e6880083 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:40.133134 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-89c1bb15-6789-464f-8052-f4f3e6880083 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:40.142655 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-b9300624-c333-466e-a5d2-9cd94ddba6a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:40.150543 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-b9300624-c333-466e-a5d2-9cd94ddba6a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.220288 Aug 03 13:01:40.151263 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 149/319] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:39 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:40.262346 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-89c1bb15-6789-464f-8052-f4f3e6880083 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:40.269794 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-89c1bb15-6789-464f-8052-f4f3e6880083 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.149407 Aug 03 13:01:40.270348 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 171/320] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:40 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:41.142330 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-6898b81a-a1db-42c8-9f58-2bc11d6ab9b6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:41.142969 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-6898b81a-a1db-42c8-9f58-2bc11d6ab9b6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:41.150261 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6898b81a-a1db-42c8-9f58-2bc11d6ab9b6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:41.151027 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6898b81a-a1db-42c8-9f58-2bc11d6ab9b6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:41.151820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6898b81a-a1db-42c8-9f58-2bc11d6ab9b6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:41.152278 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6898b81a-a1db-42c8-9f58-2bc11d6ab9b6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:41.171374 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d899d538-159b-4188-b21e-e50385a989ac tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:41.171982 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-d899d538-159b-4188-b21e-e50385a989ac tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:41.178150 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d899d538-159b-4188-b21e-e50385a989ac tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:41.178596 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d899d538-159b-4188-b21e-e50385a989ac tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:41.179373 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d899d538-159b-4188-b21e-e50385a989ac tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:41.179972 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d899d538-159b-4188-b21e-e50385a989ac tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:41.357100 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-6898b81a-a1db-42c8-9f58-2bc11d6ab9b6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:41.364438 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-6898b81a-a1db-42c8-9f58-2bc11d6ab9b6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.226531 Aug 03 13:01:41.365006 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 150/321] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:41 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:41.369487 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d24f147e-819d-422c-84b3-58c055357879 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:41.370093 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d24f147e-819d-422c-84b3-58c055357879 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:41.376251 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d24f147e-819d-422c-84b3-58c055357879 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:41.378650 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d24f147e-819d-422c-84b3-58c055357879 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:41.378650 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d24f147e-819d-422c-84b3-58c055357879 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:41.378650 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d24f147e-819d-422c-84b3-58c055357879 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:41.394897 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-d899d538-159b-4188-b21e-e50385a989ac tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:41.395753 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=100 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:41.403877 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-d899d538-159b-4188-b21e-e50385a989ac tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.236413 Aug 03 13:01:41.406957 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 172/322] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:41 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:01:41.515072 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d24f147e-819d-422c-84b3-58c055357879 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:41.522512 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d24f147e-819d-422c-84b3-58c055357879 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.156573 Aug 03 13:01:41.523175 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 151/323] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:41 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:42.385237 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-1ca5d330-2e0a-4a4e-8feb-ddf37e1d6231 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:42.385877 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-1ca5d330-2e0a-4a4e-8feb-ddf37e1d6231 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:42.391972 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1ca5d330-2e0a-4a4e-8feb-ddf37e1d6231 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:42.392416 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1ca5d330-2e0a-4a4e-8feb-ddf37e1d6231 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:42.393168 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1ca5d330-2e0a-4a4e-8feb-ddf37e1d6231 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:42.393621 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1ca5d330-2e0a-4a4e-8feb-ddf37e1d6231 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:42.426184 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-300379d8-8601-45b3-bde4-e1fba4de96a9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:42.426928 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-300379d8-8601-45b3-bde4-e1fba4de96a9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:42.435767 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-300379d8-8601-45b3-bde4-e1fba4de96a9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:42.435767 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-300379d8-8601-45b3-bde4-e1fba4de96a9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:42.435767 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-300379d8-8601-45b3-bde4-e1fba4de96a9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:42.436183 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-300379d8-8601-45b3-bde4-e1fba4de96a9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:42.575363 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-1ca5d330-2e0a-4a4e-8feb-ddf37e1d6231 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:42.582620 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-1ca5d330-2e0a-4a4e-8feb-ddf37e1d6231 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.201294 Aug 03 13:01:42.583216 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 173/324] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:42 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:01:42.587688 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-fc12b884-5f35-4df8-817a-7a132d12860b tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:42.588289 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-fc12b884-5f35-4df8-817a-7a132d12860b tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:42.599874 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fc12b884-5f35-4df8-817a-7a132d12860b tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:42.600318 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fc12b884-5f35-4df8-817a-7a132d12860b tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:42.601103 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fc12b884-5f35-4df8-817a-7a132d12860b tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:42.601535 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fc12b884-5f35-4df8-817a-7a132d12860b tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:42.604742 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-300379d8-8601-45b3-bde4-e1fba4de96a9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:42.612089 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-300379d8-8601-45b3-bde4-e1fba4de96a9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.190628 Aug 03 13:01:42.622814 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 152/325] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:42 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:01:42.729800 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-fc12b884-5f35-4df8-817a-7a132d12860b tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:42.737024 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-fc12b884-5f35-4df8-817a-7a132d12860b tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.152824 Aug 03 13:01:42.738140 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 174/326] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:42 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:43.603776 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-98213ba4-74ef-40eb-a731-8717cb8c79f6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:43.604523 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-98213ba4-74ef-40eb-a731-8717cb8c79f6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:43.611031 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-98213ba4-74ef-40eb-a731-8717cb8c79f6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:43.615642 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-98213ba4-74ef-40eb-a731-8717cb8c79f6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:43.615642 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-98213ba4-74ef-40eb-a731-8717cb8c79f6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:43.615642 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-98213ba4-74ef-40eb-a731-8717cb8c79f6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:43.632964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-04963b09-bb78-4b52-9ddb-d03d8fcbf924 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:43.638568 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-04963b09-bb78-4b52-9ddb-d03d8fcbf924 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:43.640023 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-04963b09-bb78-4b52-9ddb-d03d8fcbf924 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:43.640534 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-04963b09-bb78-4b52-9ddb-d03d8fcbf924 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:43.641299 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-04963b09-bb78-4b52-9ddb-d03d8fcbf924 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:43.641727 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-04963b09-bb78-4b52-9ddb-d03d8fcbf924 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:43.811776 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-98213ba4-74ef-40eb-a731-8717cb8c79f6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:43.816392 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-04963b09-bb78-4b52-9ddb-d03d8fcbf924 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:43.819455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-98213ba4-74ef-40eb-a731-8717cb8c79f6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.219450 Aug 03 13:01:43.824957 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 153/327] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:43 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:43.825088 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-04963b09-bb78-4b52-9ddb-d03d8fcbf924 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.195312 Aug 03 13:01:43.825198 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-545243b9-3170-4ee0-aac0-9005d46a67b4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:43.825198 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-545243b9-3170-4ee0-aac0-9005d46a67b4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:43.831706 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-545243b9-3170-4ee0-aac0-9005d46a67b4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:43.832159 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-545243b9-3170-4ee0-aac0-9005d46a67b4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:43.832916 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-545243b9-3170-4ee0-aac0-9005d46a67b4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:43.833350 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-545243b9-3170-4ee0-aac0-9005d46a67b4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:43.838181 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 175/328] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:43 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:43.961173 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-545243b9-3170-4ee0-aac0-9005d46a67b4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:43.968655 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-545243b9-3170-4ee0-aac0-9005d46a67b4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.147516 Aug 03 13:01:43.969215 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 154/329] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:43 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:44.840205 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-556a67cc-d542-4d5c-a95e-d8d94371284e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:44.841482 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-556a67cc-d542-4d5c-a95e-d8d94371284e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:44.845796 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-0f2d5d94-8241-4d6b-9d72-024c2f210673 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:44.846421 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-0f2d5d94-8241-4d6b-9d72-024c2f210673 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:44.848133 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-556a67cc-d542-4d5c-a95e-d8d94371284e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:44.848584 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-556a67cc-d542-4d5c-a95e-d8d94371284e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:44.849344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-556a67cc-d542-4d5c-a95e-d8d94371284e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:44.849779 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-556a67cc-d542-4d5c-a95e-d8d94371284e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:44.853087 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0f2d5d94-8241-4d6b-9d72-024c2f210673 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:44.854941 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0f2d5d94-8241-4d6b-9d72-024c2f210673 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:44.854941 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0f2d5d94-8241-4d6b-9d72-024c2f210673 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:44.854941 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0f2d5d94-8241-4d6b-9d72-024c2f210673 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:45.042026 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-556a67cc-d542-4d5c-a95e-d8d94371284e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:45.047037 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-0f2d5d94-8241-4d6b-9d72-024c2f210673 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:45.049535 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-556a67cc-d542-4d5c-a95e-d8d94371284e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.213119 Aug 03 13:01:45.051231 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 176/330] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:44 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:45.055518 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-0f2d5d94-8241-4d6b-9d72-024c2f210673 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.214083 Aug 03 13:01:45.055722 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-31f05ec0-97e3-4128-ad50-9bc1d71695f3 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:45.056297 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 155/331] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:44 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:45.056462 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-31f05ec0-97e3-4128-ad50-9bc1d71695f3 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:45.065364 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-31f05ec0-97e3-4128-ad50-9bc1d71695f3 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:45.065808 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-31f05ec0-97e3-4128-ad50-9bc1d71695f3 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:45.066589 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-31f05ec0-97e3-4128-ad50-9bc1d71695f3 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:45.067040 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-31f05ec0-97e3-4128-ad50-9bc1d71695f3 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:45.192995 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-31f05ec0-97e3-4128-ad50-9bc1d71695f3 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:45.200393 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-31f05ec0-97e3-4128-ad50-9bc1d71695f3 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.148228 Aug 03 13:01:45.200946 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 177/332] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:45 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:46.082140 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d15ec12f-3c0e-4050-83f0-68743bad8d6e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:46.082812 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d15ec12f-3c0e-4050-83f0-68743bad8d6e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:46.087550 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-de820158-afa2-46e4-bb4d-bc2576f439ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:46.088289 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-de820158-afa2-46e4-bb4d-bc2576f439ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:46.089380 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d15ec12f-3c0e-4050-83f0-68743bad8d6e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:46.089833 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d15ec12f-3c0e-4050-83f0-68743bad8d6e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:46.090599 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d15ec12f-3c0e-4050-83f0-68743bad8d6e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:46.091064 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d15ec12f-3c0e-4050-83f0-68743bad8d6e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:46.094303 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-de820158-afa2-46e4-bb4d-bc2576f439ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:46.094777 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-de820158-afa2-46e4-bb4d-bc2576f439ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:46.095573 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-de820158-afa2-46e4-bb4d-bc2576f439ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:46.096009 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-de820158-afa2-46e4-bb4d-bc2576f439ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:46.281512 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d15ec12f-3c0e-4050-83f0-68743bad8d6e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:46.288474 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-de820158-afa2-46e4-bb4d-bc2576f439ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:46.289142 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d15ec12f-3c0e-4050-83f0-68743bad8d6e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.210989 Aug 03 13:01:46.289718 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 156/333] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:46 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:46.294256 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-b5c1d313-2cf6-4e15-99f2-be3e83a01498 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:46.294826 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-b5c1d313-2cf6-4e15-99f2-be3e83a01498 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:46.296211 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-de820158-afa2-46e4-bb4d-bc2576f439ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.212598 Aug 03 13:01:46.297202 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 178/334] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:46 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:01:46.301274 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b5c1d313-2cf6-4e15-99f2-be3e83a01498 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:46.301725 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b5c1d313-2cf6-4e15-99f2-be3e83a01498 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:46.302486 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b5c1d313-2cf6-4e15-99f2-be3e83a01498 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:46.302964 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b5c1d313-2cf6-4e15-99f2-be3e83a01498 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:46.434968 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-b5c1d313-2cf6-4e15-99f2-be3e83a01498 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:46.442250 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-b5c1d313-2cf6-4e15-99f2-be3e83a01498 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.151492 Aug 03 13:01:46.442819 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 157/335] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:46 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:47.310263 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-a5868f6d-493c-4a3f-9f71-1bba91505676 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:47.310902 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-a5868f6d-493c-4a3f-9f71-1bba91505676 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:47.317674 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-7014040c-95c5-421f-a394-e0df61540627 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:47.318091 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a5868f6d-493c-4a3f-9f71-1bba91505676 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:47.318198 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a5868f6d-493c-4a3f-9f71-1bba91505676 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:47.318294 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-7014040c-95c5-421f-a394-e0df61540627 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:47.318915 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a5868f6d-493c-4a3f-9f71-1bba91505676 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:47.319351 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a5868f6d-493c-4a3f-9f71-1bba91505676 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:47.324905 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7014040c-95c5-421f-a394-e0df61540627 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:47.325356 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7014040c-95c5-421f-a394-e0df61540627 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:47.326114 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7014040c-95c5-421f-a394-e0df61540627 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:47.326553 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7014040c-95c5-421f-a394-e0df61540627 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:47.511267 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-a5868f6d-493c-4a3f-9f71-1bba91505676 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:47.514406 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-7014040c-95c5-421f-a394-e0df61540627 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:47.518843 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-a5868f6d-493c-4a3f-9f71-1bba91505676 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.212322 Aug 03 13:01:47.525998 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 179/336] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:47 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:47.526138 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-7014040c-95c5-421f-a394-e0df61540627 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.208808 Aug 03 13:01:47.526138 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 158/337] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:47 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:01:47.526315 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-7fed1da1-2388-42e5-8e88-981c6c5ac82b tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:47.526315 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-7fed1da1-2388-42e5-8e88-981c6c5ac82b tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:47.530680 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7fed1da1-2388-42e5-8e88-981c6c5ac82b tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:47.531178 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7fed1da1-2388-42e5-8e88-981c6c5ac82b tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:47.531961 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7fed1da1-2388-42e5-8e88-981c6c5ac82b tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:47.532397 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7fed1da1-2388-42e5-8e88-981c6c5ac82b tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:47.656957 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-7fed1da1-2388-42e5-8e88-981c6c5ac82b tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:47.664408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-7fed1da1-2388-42e5-8e88-981c6c5ac82b tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.143987 Aug 03 13:01:47.664967 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 180/338] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:47 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:48.540755 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-846b8211-73e1-477c-ab43-b90b34ef2e25 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:48.541389 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-846b8211-73e1-477c-ab43-b90b34ef2e25 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:48.543977 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-a9806e65-90ed-4602-bc30-45acc9988aab tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:48.544643 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-a9806e65-90ed-4602-bc30-45acc9988aab tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:48.547991 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-846b8211-73e1-477c-ab43-b90b34ef2e25 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:48.548437 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-846b8211-73e1-477c-ab43-b90b34ef2e25 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:48.549192 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-846b8211-73e1-477c-ab43-b90b34ef2e25 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:48.549778 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-846b8211-73e1-477c-ab43-b90b34ef2e25 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:48.551046 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a9806e65-90ed-4602-bc30-45acc9988aab tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:48.551497 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a9806e65-90ed-4602-bc30-45acc9988aab tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:48.552261 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a9806e65-90ed-4602-bc30-45acc9988aab tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:48.552693 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a9806e65-90ed-4602-bc30-45acc9988aab tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:48.743512 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-846b8211-73e1-477c-ab43-b90b34ef2e25 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:48.747925 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-a9806e65-90ed-4602-bc30-45acc9988aab tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:48.751337 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-846b8211-73e1-477c-ab43-b90b34ef2e25 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.214512 Aug 03 13:01:48.752098 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 159/339] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:48 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:48.758972 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e85d6e7c-d881-4d01-bd92-5918afc2dac7 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:48.759705 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-e85d6e7c-d881-4d01-bd92-5918afc2dac7 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:48.767417 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-a9806e65-90ed-4602-bc30-45acc9988aab tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.227095 Aug 03 13:01:48.778762 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 181/340] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:48 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:48.779019 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e85d6e7c-d881-4d01-bd92-5918afc2dac7 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:48.779019 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e85d6e7c-d881-4d01-bd92-5918afc2dac7 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:48.779019 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e85d6e7c-d881-4d01-bd92-5918afc2dac7 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:48.779019 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e85d6e7c-d881-4d01-bd92-5918afc2dac7 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:48.896627 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-e85d6e7c-d881-4d01-bd92-5918afc2dac7 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:48.904576 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-e85d6e7c-d881-4d01-bd92-5918afc2dac7 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.150920 Aug 03 13:01:48.905135 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 160/341] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:48 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:49.772604 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-051a117c-3ec1-4ee4-9c48-fe522bd4ef8c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:49.773139 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-051a117c-3ec1-4ee4-9c48-fe522bd4ef8c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:49.779111 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-051a117c-3ec1-4ee4-9c48-fe522bd4ef8c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:49.779552 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-051a117c-3ec1-4ee4-9c48-fe522bd4ef8c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:49.780302 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-051a117c-3ec1-4ee4-9c48-fe522bd4ef8c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:49.780983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-051a117c-3ec1-4ee4-9c48-fe522bd4ef8c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:49.789693 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-ed7d21e9-454c-417b-b54d-0a70e7c2da97 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:49.794943 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-ed7d21e9-454c-417b-b54d-0a70e7c2da97 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:49.796801 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ed7d21e9-454c-417b-b54d-0a70e7c2da97 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:49.797337 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ed7d21e9-454c-417b-b54d-0a70e7c2da97 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:49.798154 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ed7d21e9-454c-417b-b54d-0a70e7c2da97 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:49.798596 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ed7d21e9-454c-417b-b54d-0a70e7c2da97 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:49.977221 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-051a117c-3ec1-4ee4-9c48-fe522bd4ef8c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:49.980599 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=100 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:49.985021 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-051a117c-3ec1-4ee4-9c48-fe522bd4ef8c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.216346 Aug 03 13:01:49.998973 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 182/342] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:49 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:49.999098 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ed7d21e9-454c-417b-b54d-0a70e7c2da97 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:49.999216 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-a9738e9d-d525-4d43-a034-0236fd1e81c5 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:49.999216 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-a9738e9d-d525-4d43-a034-0236fd1e81c5 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:49.999389 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-ed7d21e9-454c-417b-b54d-0a70e7c2da97 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.210982 Aug 03 13:01:49.999471 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a9738e9d-d525-4d43-a034-0236fd1e81c5 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:49.999471 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a9738e9d-d525-4d43-a034-0236fd1e81c5 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:49.999629 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 161/343] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:49 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:01:49.999701 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a9738e9d-d525-4d43-a034-0236fd1e81c5 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:49.999701 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a9738e9d-d525-4d43-a034-0236fd1e81c5 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:50.132038 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-a9738e9d-d525-4d43-a034-0236fd1e81c5 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:50.139921 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-a9738e9d-d525-4d43-a034-0236fd1e81c5 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.153425 Aug 03 13:01:50.146998 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 183/344] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:49 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:51.005766 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-7d33f03f-6373-4e95-acd4-7dd35aa9de4e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:51.006299 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-7d33f03f-6373-4e95-acd4-7dd35aa9de4e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:51.013013 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7d33f03f-6373-4e95-acd4-7dd35aa9de4e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:51.013460 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7d33f03f-6373-4e95-acd4-7dd35aa9de4e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:51.014252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7d33f03f-6373-4e95-acd4-7dd35aa9de4e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:51.014683 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7d33f03f-6373-4e95-acd4-7dd35aa9de4e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:51.017238 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-a2a6b391-46eb-4e06-b54a-99ea05281f60 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:51.017732 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-a2a6b391-46eb-4e06-b54a-99ea05281f60 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:51.023755 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a2a6b391-46eb-4e06-b54a-99ea05281f60 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:51.024204 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a2a6b391-46eb-4e06-b54a-99ea05281f60 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:51.024995 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a2a6b391-46eb-4e06-b54a-99ea05281f60 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:51.025425 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a2a6b391-46eb-4e06-b54a-99ea05281f60 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:51.205147 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-7d33f03f-6373-4e95-acd4-7dd35aa9de4e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:51.213254 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-7d33f03f-6373-4e95-acd4-7dd35aa9de4e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.211464 Aug 03 13:01:51.213810 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 162/345] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:51 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:51.227188 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1d9f9a0e-68ff-4853-9a6f-50f791e1161d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:51.227188 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-1d9f9a0e-68ff-4853-9a6f-50f791e1161d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:51.231288 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-a2a6b391-46eb-4e06-b54a-99ea05281f60 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:51.231433 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1d9f9a0e-68ff-4853-9a6f-50f791e1161d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:51.231433 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1d9f9a0e-68ff-4853-9a6f-50f791e1161d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:51.231433 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1d9f9a0e-68ff-4853-9a6f-50f791e1161d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:51.231433 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1d9f9a0e-68ff-4853-9a6f-50f791e1161d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:51.231692 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-a2a6b391-46eb-4e06-b54a-99ea05281f60 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.217909 Aug 03 13:01:51.231810 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 184/346] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:51 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:01:51.354526 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-1d9f9a0e-68ff-4853-9a6f-50f791e1161d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:51.361863 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-1d9f9a0e-68ff-4853-9a6f-50f791e1161d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.147017 Aug 03 13:01:51.362418 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 163/347] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:51 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:52.234091 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-a6115d04-bb95-4ea5-8746-52dbed5a2a02 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:52.234703 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-a6115d04-bb95-4ea5-8746-52dbed5a2a02 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:52.241377 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a6115d04-bb95-4ea5-8746-52dbed5a2a02 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:52.241820 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a6115d04-bb95-4ea5-8746-52dbed5a2a02 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:52.242577 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a6115d04-bb95-4ea5-8746-52dbed5a2a02 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:52.243035 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a6115d04-bb95-4ea5-8746-52dbed5a2a02 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:52.253986 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-72cf11ad-313d-4b89-935e-88d4204a3138 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:52.254673 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-72cf11ad-313d-4b89-935e-88d4204a3138 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:52.261251 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-72cf11ad-313d-4b89-935e-88d4204a3138 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:52.262827 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-72cf11ad-313d-4b89-935e-88d4204a3138 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:52.262827 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-72cf11ad-313d-4b89-935e-88d4204a3138 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:52.263034 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-72cf11ad-313d-4b89-935e-88d4204a3138 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:52.442449 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-a6115d04-bb95-4ea5-8746-52dbed5a2a02 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:52.446659 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-72cf11ad-313d-4b89-935e-88d4204a3138 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:52.450066 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-a6115d04-bb95-4ea5-8746-52dbed5a2a02 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.219975 Aug 03 13:01:52.450631 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 185/348] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:52 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:52.454497 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-72cf11ad-313d-4b89-935e-88d4204a3138 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.205304 Aug 03 13:01:52.455062 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-f552d46e-2416-4c5d-af91-6edf7ff6a8e5 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:52.455369 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 164/349] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:52 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:01:52.460586 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-f552d46e-2416-4c5d-af91-6edf7ff6a8e5 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:52.466577 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f552d46e-2416-4c5d-af91-6edf7ff6a8e5 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:52.467161 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f552d46e-2416-4c5d-af91-6edf7ff6a8e5 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:52.468795 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f552d46e-2416-4c5d-af91-6edf7ff6a8e5 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:52.468795 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f552d46e-2416-4c5d-af91-6edf7ff6a8e5 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:52.593601 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-f552d46e-2416-4c5d-af91-6edf7ff6a8e5 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:52.601352 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-f552d46e-2416-4c5d-af91-6edf7ff6a8e5 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.149755 Aug 03 13:01:52.601903 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 186/350] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:52 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:53.470677 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-a4bfa94e-e507-487d-8c95-b289d6fd138a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:53.471420 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-a4bfa94e-e507-487d-8c95-b289d6fd138a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:53.474829 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-6b6a92a9-e76a-4442-83d3-206d214a8c4b tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:53.475471 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-6b6a92a9-e76a-4442-83d3-206d214a8c4b tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:53.478085 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a4bfa94e-e507-487d-8c95-b289d6fd138a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:53.478540 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a4bfa94e-e507-487d-8c95-b289d6fd138a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:53.479336 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a4bfa94e-e507-487d-8c95-b289d6fd138a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:53.479777 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a4bfa94e-e507-487d-8c95-b289d6fd138a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:53.481508 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6b6a92a9-e76a-4442-83d3-206d214a8c4b tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:53.481950 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6b6a92a9-e76a-4442-83d3-206d214a8c4b tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:53.482707 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6b6a92a9-e76a-4442-83d3-206d214a8c4b tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:53.483178 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6b6a92a9-e76a-4442-83d3-206d214a8c4b tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:53.672698 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-a4bfa94e-e507-487d-8c95-b289d6fd138a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:53.680548 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-6b6a92a9-e76a-4442-83d3-206d214a8c4b tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:53.680799 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-a4bfa94e-e507-487d-8c95-b289d6fd138a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.214135 Aug 03 13:01:53.681405 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 165/351] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:53 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:53.685852 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-df58addf-48a1-4fa0-9ccd-2da2de2288f6 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:53.686438 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-df58addf-48a1-4fa0-9ccd-2da2de2288f6 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:53.693091 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-df58addf-48a1-4fa0-9ccd-2da2de2288f6 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:53.693746 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-df58addf-48a1-4fa0-9ccd-2da2de2288f6 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:53.694574 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-df58addf-48a1-4fa0-9ccd-2da2de2288f6 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:53.695095 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-df58addf-48a1-4fa0-9ccd-2da2de2288f6 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:53.696426 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-6b6a92a9-e76a-4442-83d3-206d214a8c4b tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.225456 Aug 03 13:01:53.696995 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 187/352] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:53 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:01:53.824936 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-df58addf-48a1-4fa0-9ccd-2da2de2288f6 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:53.832167 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-df58addf-48a1-4fa0-9ccd-2da2de2288f6 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.149829 Aug 03 13:01:53.832757 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 166/353] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:53 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:54.701352 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-6f6dd82f-a669-437d-bb47-434b9c4bfd8b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:54.702001 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-6f6dd82f-a669-437d-bb47-434b9c4bfd8b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:54.708694 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6f6dd82f-a669-437d-bb47-434b9c4bfd8b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:54.709141 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6f6dd82f-a669-437d-bb47-434b9c4bfd8b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:54.709909 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6f6dd82f-a669-437d-bb47-434b9c4bfd8b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:54.710341 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6f6dd82f-a669-437d-bb47-434b9c4bfd8b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:54.716418 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-02e2588e-5829-4a4d-94dd-bd8b4bce88bb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:54.717120 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-02e2588e-5829-4a4d-94dd-bd8b4bce88bb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:54.723638 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-02e2588e-5829-4a4d-94dd-bd8b4bce88bb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:54.724085 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-02e2588e-5829-4a4d-94dd-bd8b4bce88bb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:54.724853 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-02e2588e-5829-4a4d-94dd-bd8b4bce88bb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:54.725290 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-02e2588e-5829-4a4d-94dd-bd8b4bce88bb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:54.901971 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-6f6dd82f-a669-437d-bb47-434b9c4bfd8b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:54.908919 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-02e2588e-5829-4a4d-94dd-bd8b4bce88bb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:54.909562 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-6f6dd82f-a669-437d-bb47-434b9c4bfd8b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.212071 Aug 03 13:01:54.910133 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 188/354] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:54 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:54.914509 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-793170be-5742-48eb-8f42-e42ac7998633 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:54.915315 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-793170be-5742-48eb-8f42-e42ac7998633 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:54.916442 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-02e2588e-5829-4a4d-94dd-bd8b4bce88bb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.203813 Aug 03 13:01:54.917133 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 167/355] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:54 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:01:54.921285 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-793170be-5742-48eb-8f42-e42ac7998633 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:54.921731 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-793170be-5742-48eb-8f42-e42ac7998633 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:54.922484 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-793170be-5742-48eb-8f42-e42ac7998633 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:54.923097 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-793170be-5742-48eb-8f42-e42ac7998633 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:55.057262 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-793170be-5742-48eb-8f42-e42ac7998633 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:55.065704 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-793170be-5742-48eb-8f42-e42ac7998633 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.153960 Aug 03 13:01:55.066253 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 189/356] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:54 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:55.929874 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-51aaefb9-02dd-47f7-85d0-c286960cca1d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:55.930510 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-51aaefb9-02dd-47f7-85d0-c286960cca1d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:55.937319 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-51aaefb9-02dd-47f7-85d0-c286960cca1d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:55.938110 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-51aaefb9-02dd-47f7-85d0-c286960cca1d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:55.938211 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-71662f9f-2bfc-4de1-aa48-5540bad23346 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:55.938843 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-71662f9f-2bfc-4de1-aa48-5540bad23346 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:55.939282 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-51aaefb9-02dd-47f7-85d0-c286960cca1d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:55.939725 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-51aaefb9-02dd-47f7-85d0-c286960cca1d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:55.945006 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=100 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:55.948291 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-71662f9f-2bfc-4de1-aa48-5540bad23346 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:55.948941 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-71662f9f-2bfc-4de1-aa48-5540bad23346 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:55.949717 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-71662f9f-2bfc-4de1-aa48-5540bad23346 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:55.950144 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-71662f9f-2bfc-4de1-aa48-5540bad23346 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:56.138617 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-51aaefb9-02dd-47f7-85d0-c286960cca1d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:56.143684 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-71662f9f-2bfc-4de1-aa48-5540bad23346 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:56.146621 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-51aaefb9-02dd-47f7-85d0-c286960cca1d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.220371 Aug 03 13:01:56.148241 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 168/357] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:55 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:56.153030 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-2c813ad4-f24c-41b2-99e9-e2f4d21fbcf1 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:56.154363 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-2c813ad4-f24c-41b2-99e9-e2f4d21fbcf1 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:56.162319 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2c813ad4-f24c-41b2-99e9-e2f4d21fbcf1 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:56.162957 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2c813ad4-f24c-41b2-99e9-e2f4d21fbcf1 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:56.163745 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-71662f9f-2bfc-4de1-aa48-5540bad23346 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.230052 Aug 03 13:01:56.164232 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2c813ad4-f24c-41b2-99e9-e2f4d21fbcf1 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:56.164357 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 190/358] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:55 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:01:56.164951 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2c813ad4-f24c-41b2-99e9-e2f4d21fbcf1 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:56.289898 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-2c813ad4-f24c-41b2-99e9-e2f4d21fbcf1 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:56.297213 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-2c813ad4-f24c-41b2-99e9-e2f4d21fbcf1 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.147795 Aug 03 13:01:56.297773 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 169/359] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:56 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:57.170586 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-439c09b6-496a-4a2d-b37b-419fbab976b3 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:57.171473 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-439c09b6-496a-4a2d-b37b-419fbab976b3 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:57.177248 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-439c09b6-496a-4a2d-b37b-419fbab976b3 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:57.177690 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-439c09b6-496a-4a2d-b37b-419fbab976b3 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:57.178443 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-439c09b6-496a-4a2d-b37b-419fbab976b3 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:57.180394 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-439c09b6-496a-4a2d-b37b-419fbab976b3 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:57.185098 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-38848e46-8668-4867-a434-60dd7d1e6a09 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:57.185712 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-38848e46-8668-4867-a434-60dd7d1e6a09 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:57.192712 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-38848e46-8668-4867-a434-60dd7d1e6a09 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:57.193169 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-38848e46-8668-4867-a434-60dd7d1e6a09 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:57.193973 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-38848e46-8668-4867-a434-60dd7d1e6a09 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:57.194412 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-38848e46-8668-4867-a434-60dd7d1e6a09 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:57.378933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-439c09b6-496a-4a2d-b37b-419fbab976b3 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:57.386188 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-439c09b6-496a-4a2d-b37b-419fbab976b3 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.219386 Aug 03 13:01:57.386756 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 191/360] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:57 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:57.391348 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-c463d8eb-05f9-4692-9269-c04388bab6b3 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:57.391940 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-c463d8eb-05f9-4692-9269-c04388bab6b3 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:57.392979 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-38848e46-8668-4867-a434-60dd7d1e6a09 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:57.397926 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c463d8eb-05f9-4692-9269-c04388bab6b3 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:57.398349 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c463d8eb-05f9-4692-9269-c04388bab6b3 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:57.399382 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c463d8eb-05f9-4692-9269-c04388bab6b3 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:57.399814 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c463d8eb-05f9-4692-9269-c04388bab6b3 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:57.400768 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-38848e46-8668-4867-a434-60dd7d1e6a09 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.219548 Aug 03 13:01:57.401332 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 170/361] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:57 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:01:57.526678 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-c463d8eb-05f9-4692-9269-c04388bab6b3 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:57.535142 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-c463d8eb-05f9-4692-9269-c04388bab6b3 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.147396 Aug 03 13:01:57.535855 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 192/362] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:57 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:58.407462 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-3ad3fa07-bc56-4d09-a62c-bd2b5f5dc46f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:58.408010 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-3ad3fa07-bc56-4d09-a62c-bd2b5f5dc46f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:58.414519 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3ad3fa07-bc56-4d09-a62c-bd2b5f5dc46f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:58.414995 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3ad3fa07-bc56-4d09-a62c-bd2b5f5dc46f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:58.415757 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3ad3fa07-bc56-4d09-a62c-bd2b5f5dc46f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:58.416191 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3ad3fa07-bc56-4d09-a62c-bd2b5f5dc46f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:58.421485 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-c9182886-64dc-4aaf-904b-ca5f80e7ab4f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:58.422090 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-c9182886-64dc-4aaf-904b-ca5f80e7ab4f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:58.428605 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c9182886-64dc-4aaf-904b-ca5f80e7ab4f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:58.429052 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c9182886-64dc-4aaf-904b-ca5f80e7ab4f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:58.429805 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c9182886-64dc-4aaf-904b-ca5f80e7ab4f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:58.430239 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c9182886-64dc-4aaf-904b-ca5f80e7ab4f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:58.612746 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-3ad3fa07-bc56-4d09-a62c-bd2b5f5dc46f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:58.620444 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-3ad3fa07-bc56-4d09-a62c-bd2b5f5dc46f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.217109 Aug 03 13:01:58.621022 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 171/363] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:58 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:58.623577 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-c9182886-64dc-4aaf-904b-ca5f80e7ab4f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:58.625713 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-41b18e87-7a31-43a2-b86e-238cf176b075 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:58.626310 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-41b18e87-7a31-43a2-b86e-238cf176b075 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:58.631054 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-c9182886-64dc-4aaf-904b-ca5f80e7ab4f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.213285 Aug 03 13:01:58.631900 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 193/364] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:58 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:01:58.632030 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-41b18e87-7a31-43a2-b86e-238cf176b075 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:58.632432 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-41b18e87-7a31-43a2-b86e-238cf176b075 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:58.633459 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-41b18e87-7a31-43a2-b86e-238cf176b075 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:58.633901 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-41b18e87-7a31-43a2-b86e-238cf176b075 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:58.764872 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-41b18e87-7a31-43a2-b86e-238cf176b075 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:58.772195 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-41b18e87-7a31-43a2-b86e-238cf176b075 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.150248 Aug 03 13:01:58.772794 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 172/365] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:58 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:59.641070 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-4c26b75a-642a-4515-b3a8-800ae07becb9 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:59.641670 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-4c26b75a-642a-4515-b3a8-800ae07becb9 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:59.644133 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=76 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:59.648771 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4c26b75a-642a-4515-b3a8-800ae07becb9 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:59.649248 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4c26b75a-642a-4515-b3a8-800ae07becb9 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:59.650060 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4c26b75a-642a-4515-b3a8-800ae07becb9 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:59.650484 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4c26b75a-642a-4515-b3a8-800ae07becb9 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:59.651543 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-93811949-cd4a-42a2-a369-fed96bfd02fe tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:59.654400 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-93811949-cd4a-42a2-a369-fed96bfd02fe tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:59.659525 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-93811949-cd4a-42a2-a369-fed96bfd02fe tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:59.660032 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-93811949-cd4a-42a2-a369-fed96bfd02fe tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:59.660796 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-93811949-cd4a-42a2-a369-fed96bfd02fe tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:59.661235 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-93811949-cd4a-42a2-a369-fed96bfd02fe tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:59.844504 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-4c26b75a-642a-4515-b3a8-800ae07becb9 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:59.849376 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-93811949-cd4a-42a2-a369-fed96bfd02fe tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:01:59.852630 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-4c26b75a-642a-4515-b3a8-800ae07becb9 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.215265 Aug 03 13:01:59.853190 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 194/366] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:59 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:01:59.857007 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-93811949-cd4a-42a2-a369-fed96bfd02fe tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.209333 Aug 03 13:01:59.857535 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-c5e76d46-50c3-4a18-b237-1ee2aa3c3a36 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:01:59.857678 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 173/367] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:59 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:01:59.858415 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-c5e76d46-50c3-4a18-b237-1ee2aa3c3a36 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:01:59.864242 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c5e76d46-50c3-4a18-b237-1ee2aa3c3a36 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:59.864713 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c5e76d46-50c3-4a18-b237-1ee2aa3c3a36 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:59.865466 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c5e76d46-50c3-4a18-b237-1ee2aa3c3a36 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:01:59.865893 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c5e76d46-50c3-4a18-b237-1ee2aa3c3a36 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:01:59.996852 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-c5e76d46-50c3-4a18-b237-1ee2aa3c3a36 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:00.004681 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-c5e76d46-50c3-4a18-b237-1ee2aa3c3a36 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.150563 Aug 03 13:02:00.005231 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 195/368] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:01:59 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:00.873494 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-005b7ce6-0f0c-4899-8081-1353a855c5b8 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:00.874071 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-005b7ce6-0f0c-4899-8081-1353a855c5b8 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:00.877566 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-35e40810-b230-4650-82c5-0b5c6743d073 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:00.878179 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-35e40810-b230-4650-82c5-0b5c6743d073 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:00.881346 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-005b7ce6-0f0c-4899-8081-1353a855c5b8 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:00.883892 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-005b7ce6-0f0c-4899-8081-1353a855c5b8 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:00.883892 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-005b7ce6-0f0c-4899-8081-1353a855c5b8 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:00.883892 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-005b7ce6-0f0c-4899-8081-1353a855c5b8 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:00.884717 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-35e40810-b230-4650-82c5-0b5c6743d073 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:00.884717 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-35e40810-b230-4650-82c5-0b5c6743d073 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:00.885370 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-35e40810-b230-4650-82c5-0b5c6743d073 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:00.885809 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-35e40810-b230-4650-82c5-0b5c6743d073 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:01.074839 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-005b7ce6-0f0c-4899-8081-1353a855c5b8 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:01.081913 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-35e40810-b230-4650-82c5-0b5c6743d073 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:01.083723 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-005b7ce6-0f0c-4899-8081-1353a855c5b8 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.214171 Aug 03 13:02:01.086355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 174/369] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:00 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:01.089108 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-a90bab00-7997-47b8-af3e-e5f13f6132e8 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:01.089740 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-a90bab00-7997-47b8-af3e-e5f13f6132e8 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:01.089905 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-35e40810-b230-4650-82c5-0b5c6743d073 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.216596 Aug 03 13:02:01.090567 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 196/370] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:00 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:02:01.100192 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a90bab00-7997-47b8-af3e-e5f13f6132e8 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:01.100636 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a90bab00-7997-47b8-af3e-e5f13f6132e8 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:01.101400 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a90bab00-7997-47b8-af3e-e5f13f6132e8 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:01.101831 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a90bab00-7997-47b8-af3e-e5f13f6132e8 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:01.228352 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-a90bab00-7997-47b8-af3e-e5f13f6132e8 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:01.235897 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-a90bab00-7997-47b8-af3e-e5f13f6132e8 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.150313 Aug 03 13:02:01.236977 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 175/371] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:01 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:02.106406 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-552990a5-df38-4134-9e23-2fbe8bbb56aa tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:02.107032 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-552990a5-df38-4134-9e23-2fbe8bbb56aa tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:02.110065 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d660fc40-a4ed-4e00-88fc-967f434220e0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:02.110673 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d660fc40-a4ed-4e00-88fc-967f434220e0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:02.113032 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-552990a5-df38-4134-9e23-2fbe8bbb56aa tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:02.113468 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-552990a5-df38-4134-9e23-2fbe8bbb56aa tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:02.114214 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-552990a5-df38-4134-9e23-2fbe8bbb56aa tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:02.114635 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-552990a5-df38-4134-9e23-2fbe8bbb56aa tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:02.117166 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d660fc40-a4ed-4e00-88fc-967f434220e0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:02.117611 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d660fc40-a4ed-4e00-88fc-967f434220e0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:02.118366 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d660fc40-a4ed-4e00-88fc-967f434220e0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:02.118826 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d660fc40-a4ed-4e00-88fc-967f434220e0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:02.510444 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-552990a5-df38-4134-9e23-2fbe8bbb56aa tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:02.514623 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d660fc40-a4ed-4e00-88fc-967f434220e0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:02.518724 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-552990a5-df38-4134-9e23-2fbe8bbb56aa tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1313 microversion: 2.1 time: 0.416096 Aug 03 13:02:02.519392 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 197/372] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:02 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1313 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:02.522407 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d660fc40-a4ed-4e00-88fc-967f434220e0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.416178 Aug 03 13:02:02.523000 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 176/373] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:02 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:02:02.524241 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-72a35c08-b69e-4320-929c-e1270985c664 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:02.524917 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-72a35c08-b69e-4320-929c-e1270985c664 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:02.531123 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-72a35c08-b69e-4320-929c-e1270985c664 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:02.531642 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-72a35c08-b69e-4320-929c-e1270985c664 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:02.532472 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-72a35c08-b69e-4320-929c-e1270985c664 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:02.532975 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-72a35c08-b69e-4320-929c-e1270985c664 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:02.663678 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-72a35c08-b69e-4320-929c-e1270985c664 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:02.670966 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-72a35c08-b69e-4320-929c-e1270985c664 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.150465 Aug 03 13:02:02.671530 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 198/374] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:02 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:03.542247 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-6ec842a4-11b7-4674-acfb-4b2aa9fec034 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:03.546961 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-6ec842a4-11b7-4674-acfb-4b2aa9fec034 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:03.547274 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-0e394cfe-8ff1-4577-b233-7aa5f8ecaacb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:03.547920 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-0e394cfe-8ff1-4577-b233-7aa5f8ecaacb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:03.549435 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6ec842a4-11b7-4674-acfb-4b2aa9fec034 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:03.549884 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6ec842a4-11b7-4674-acfb-4b2aa9fec034 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:03.550639 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6ec842a4-11b7-4674-acfb-4b2aa9fec034 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:03.551097 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6ec842a4-11b7-4674-acfb-4b2aa9fec034 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:03.554203 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0e394cfe-8ff1-4577-b233-7aa5f8ecaacb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:03.554656 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0e394cfe-8ff1-4577-b233-7aa5f8ecaacb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:03.555455 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0e394cfe-8ff1-4577-b233-7aa5f8ecaacb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:03.555891 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0e394cfe-8ff1-4577-b233-7aa5f8ecaacb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:03.573533 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=100 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:03.744066 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-6ec842a4-11b7-4674-acfb-4b2aa9fec034 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:03.748104 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-0e394cfe-8ff1-4577-b233-7aa5f8ecaacb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:03.752451 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-6ec842a4-11b7-4674-acfb-4b2aa9fec034 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1497 microversion: 2.1 time: 0.213304 Aug 03 13:02:03.752875 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 177/375] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:03 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1497 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:03.762977 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-0e394cfe-8ff1-4577-b233-7aa5f8ecaacb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.213222 Aug 03 13:02:03.762977 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 199/376] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:03 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:02:03.763190 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-32bbd52c-0904-47e0-8975-3239f4eb5682 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:03.763190 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-32bbd52c-0904-47e0-8975-3239f4eb5682 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:03.763840 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-32bbd52c-0904-47e0-8975-3239f4eb5682 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:03.764282 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-32bbd52c-0904-47e0-8975-3239f4eb5682 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:03.765032 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-32bbd52c-0904-47e0-8975-3239f4eb5682 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:03.765459 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-32bbd52c-0904-47e0-8975-3239f4eb5682 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:03.903746 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-32bbd52c-0904-47e0-8975-3239f4eb5682 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:03.911420 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-32bbd52c-0904-47e0-8975-3239f4eb5682 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.157614 Aug 03 13:02:03.911993 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 178/377] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:03 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:04.203049 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-b538817e-02aa-4669-b5cc-58a6aee7a2fc req-c9a86a80-a7c5-4193-a3cb-7c81ca4fd1f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49e06db0-38af-484d-8cc3-40999cc5fb8a", "name": "network-vif-plugged", "status": "completed", "tag": "2afbe9eb-dc9f-4e11-aca2-d72192f28195"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:02:04.214629 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-b538817e-02aa-4669-b5cc-58a6aee7a2fc req-c9a86a80-a7c5-4193-a3cb-7c81ca4fd1f9 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:04.219188 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-b538817e-02aa-4669-b5cc-58a6aee7a2fc req-c9a86a80-a7c5-4193-a3cb-7c81ca4fd1f9 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:04.226412 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-b538817e-02aa-4669-b5cc-58a6aee7a2fc req-c9a86a80-a7c5-4193-a3cb-7c81ca4fd1f9 service nova] Creating event network-vif-plugged:2afbe9eb-dc9f-4e11-aca2-d72192f28195 for instance 49e06db0-38af-484d-8cc3-40999cc5fb8a on hv-cinder-85083 Aug 03 13:02:04.231549 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-b538817e-02aa-4669-b5cc-58a6aee7a2fc req-c9a86a80-a7c5-4193-a3cb-7c81ca4fd1f9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034117 Aug 03 13:02:04.232196 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 200/378] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:02:04.778520 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-a883cf99-77f6-472c-81fe-f4bf2cbe0e56 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:04.778934 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-a883cf99-77f6-472c-81fe-f4bf2cbe0e56 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:04.787657 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a883cf99-77f6-472c-81fe-f4bf2cbe0e56 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:04.788003 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a883cf99-77f6-472c-81fe-f4bf2cbe0e56 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:04.788886 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a883cf99-77f6-472c-81fe-f4bf2cbe0e56 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:04.789421 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a883cf99-77f6-472c-81fe-f4bf2cbe0e56 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:04.815714 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-596a8bb9-ca6b-4e35-9b9e-5bf95f5d66de tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:04.816288 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-596a8bb9-ca6b-4e35-9b9e-5bf95f5d66de tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:04.822381 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-596a8bb9-ca6b-4e35-9b9e-5bf95f5d66de tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:04.822855 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-596a8bb9-ca6b-4e35-9b9e-5bf95f5d66de tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:04.825886 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-596a8bb9-ca6b-4e35-9b9e-5bf95f5d66de tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:04.825886 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-596a8bb9-ca6b-4e35-9b9e-5bf95f5d66de tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:04.855749 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-596a8bb9-ca6b-4e35-9b9e-5bf95f5d66de tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Going to try to terminate instance {{(pid=119409) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 13:02:04.931284 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-a883cf99-77f6-472c-81fe-f4bf2cbe0e56 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:04.939122 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-a883cf99-77f6-472c-81fe-f4bf2cbe0e56 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.165250 Aug 03 13:02:04.939722 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 179/379] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:04 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:04.944554 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-c44d9416-a39d-498c-987b-426e6901b370 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:04.945342 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-c44d9416-a39d-498c-987b-426e6901b370 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:04.951404 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c44d9416-a39d-498c-987b-426e6901b370 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:04.953473 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c44d9416-a39d-498c-987b-426e6901b370 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:04.953473 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c44d9416-a39d-498c-987b-426e6901b370 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:04.953473 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c44d9416-a39d-498c-987b-426e6901b370 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:05.099613 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c44d9416-a39d-498c-987b-426e6901b370 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:05.107251 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-c44d9416-a39d-498c-987b-426e6901b370 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.166585 Aug 03 13:02:05.107819 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 180/380] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:04 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:05.120918 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-596a8bb9-ca6b-4e35-9b9e-5bf95f5d66de tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "DELETE /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 204 len: 0 microversion: 2.1 time: 0.309246 Aug 03 13:02:05.121498 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 201/381] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 3 13:02:04 2022] DELETE /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 13:02:05.129678 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-dad3374d-ddaf-4601-a4b5-8d869d32ca09 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:05.131606 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-dad3374d-ddaf-4601-a4b5-8d869d32ca09 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:05.136445 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-dad3374d-ddaf-4601-a4b5-8d869d32ca09 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:05.136896 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-dad3374d-ddaf-4601-a4b5-8d869d32ca09 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:05.137663 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-dad3374d-ddaf-4601-a4b5-8d869d32ca09 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:05.138130 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-dad3374d-ddaf-4601-a4b5-8d869d32ca09 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:05.273563 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-dad3374d-ddaf-4601-a4b5-8d869d32ca09 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:05.281364 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-dad3374d-ddaf-4601-a4b5-8d869d32ca09 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1503 microversion: 2.1 time: 0.155764 Aug 03 13:02:05.281930 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 181/382] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:05 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:02:05.960093 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ad236bcd-8f9d-4d2d-aa1b-cba6a207af3a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:05.960773 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-ad236bcd-8f9d-4d2d-aa1b-cba6a207af3a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:05.966665 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ad236bcd-8f9d-4d2d-aa1b-cba6a207af3a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:05.970135 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ad236bcd-8f9d-4d2d-aa1b-cba6a207af3a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:05.970135 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ad236bcd-8f9d-4d2d-aa1b-cba6a207af3a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:05.970135 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ad236bcd-8f9d-4d2d-aa1b-cba6a207af3a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:06.101614 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ad236bcd-8f9d-4d2d-aa1b-cba6a207af3a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:06.109121 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-ad236bcd-8f9d-4d2d-aa1b-cba6a207af3a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.153183 Aug 03 13:02:06.109679 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 202/383] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:05 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:06.127834 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-581ab88f-8434-4c7f-800f-b89ea72b4178 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:06.128443 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-581ab88f-8434-4c7f-800f-b89ea72b4178 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:06.134908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-581ab88f-8434-4c7f-800f-b89ea72b4178 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:06.135355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-581ab88f-8434-4c7f-800f-b89ea72b4178 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:06.136110 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-581ab88f-8434-4c7f-800f-b89ea72b4178 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:06.136538 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-581ab88f-8434-4c7f-800f-b89ea72b4178 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:06.269445 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-581ab88f-8434-4c7f-800f-b89ea72b4178 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:06.276949 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-581ab88f-8434-4c7f-800f-b89ea72b4178 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.153038 Aug 03 13:02:06.277507 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 182/384] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:06 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:06.301738 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-c109c362-012f-4935-8a44-2adb9ed52719 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:06.302383 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-c109c362-012f-4935-8a44-2adb9ed52719 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:06.308281 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c109c362-012f-4935-8a44-2adb9ed52719 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:06.308724 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c109c362-012f-4935-8a44-2adb9ed52719 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:06.309478 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c109c362-012f-4935-8a44-2adb9ed52719 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:06.309910 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c109c362-012f-4935-8a44-2adb9ed52719 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:06.434500 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-c109c362-012f-4935-8a44-2adb9ed52719 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:06.442584 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-c109c362-012f-4935-8a44-2adb9ed52719 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1503 microversion: 2.1 time: 0.145160 Aug 03 13:02:06.443175 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 203/385] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:06 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1503 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:07.129313 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-06b81e7d-ee02-4a7b-adb7-e21efb0c81f6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:07.129920 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-06b81e7d-ee02-4a7b-adb7-e21efb0c81f6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:07.136364 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-06b81e7d-ee02-4a7b-adb7-e21efb0c81f6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:07.136813 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-06b81e7d-ee02-4a7b-adb7-e21efb0c81f6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:07.137563 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-06b81e7d-ee02-4a7b-adb7-e21efb0c81f6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:07.137994 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-06b81e7d-ee02-4a7b-adb7-e21efb0c81f6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:07.272197 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-06b81e7d-ee02-4a7b-adb7-e21efb0c81f6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:07.279886 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-06b81e7d-ee02-4a7b-adb7-e21efb0c81f6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.154365 Aug 03 13:02:07.280796 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 183/386] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:07 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:07.297133 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-b75dff9f-f2bc-4b59-ac54-aa69a2998bf4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:07.297749 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-b75dff9f-f2bc-4b59-ac54-aa69a2998bf4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:07.303676 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b75dff9f-f2bc-4b59-ac54-aa69a2998bf4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:07.304120 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b75dff9f-f2bc-4b59-ac54-aa69a2998bf4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:07.304874 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b75dff9f-f2bc-4b59-ac54-aa69a2998bf4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:07.305302 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b75dff9f-f2bc-4b59-ac54-aa69a2998bf4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:07.433185 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b75dff9f-f2bc-4b59-ac54-aa69a2998bf4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:07.441148 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-b75dff9f-f2bc-4b59-ac54-aa69a2998bf4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.147770 Aug 03 13:02:07.441702 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 204/387] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:07 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:07.463173 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d58f7225-a4eb-4413-bcdb-28e20312699d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:07.463820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d58f7225-a4eb-4413-bcdb-28e20312699d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:07.469913 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d58f7225-a4eb-4413-bcdb-28e20312699d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:07.470401 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d58f7225-a4eb-4413-bcdb-28e20312699d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:07.471267 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d58f7225-a4eb-4413-bcdb-28e20312699d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:07.471702 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d58f7225-a4eb-4413-bcdb-28e20312699d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:07.600614 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d58f7225-a4eb-4413-bcdb-28e20312699d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:07.602827 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=100 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:07.608654 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d58f7225-a4eb-4413-bcdb-28e20312699d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1503 microversion: 2.1 time: 0.149326 Aug 03 13:02:07.609215 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 184/388] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:07 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:08.303116 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-fc5d9d08-6d15-4802-8d91-67f091bedcfc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:08.303725 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-fc5d9d08-6d15-4802-8d91-67f091bedcfc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:08.309718 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fc5d9d08-6d15-4802-8d91-67f091bedcfc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:08.310159 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fc5d9d08-6d15-4802-8d91-67f091bedcfc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:08.310947 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fc5d9d08-6d15-4802-8d91-67f091bedcfc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:08.311381 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fc5d9d08-6d15-4802-8d91-67f091bedcfc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:08.462068 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-fee5c86e-3581-4271-ae15-16cfc59dd265 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:08.462676 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-fee5c86e-3581-4271-ae15-16cfc59dd265 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:08.469682 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fee5c86e-3581-4271-ae15-16cfc59dd265 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:08.470142 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fee5c86e-3581-4271-ae15-16cfc59dd265 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:08.471588 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fee5c86e-3581-4271-ae15-16cfc59dd265 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:08.472019 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fee5c86e-3581-4271-ae15-16cfc59dd265 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:08.633165 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-fc5d9d08-6d15-4802-8d91-67f091bedcfc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:08.641133 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-fc5d9d08-6d15-4802-8d91-67f091bedcfc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.342422 Aug 03 13:02:08.642754 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 205/389] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:08 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:08.646525 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-fee5c86e-3581-4271-ae15-16cfc59dd265 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:08.649711 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-468d6ead-dfd2-42e9-a6f8-dde7a58ac4cc tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:08.650376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-468d6ead-dfd2-42e9-a6f8-dde7a58ac4cc tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:08.657280 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-468d6ead-dfd2-42e9-a6f8-dde7a58ac4cc tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:08.657731 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-468d6ead-dfd2-42e9-a6f8-dde7a58ac4cc tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:08.659367 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-468d6ead-dfd2-42e9-a6f8-dde7a58ac4cc tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:08.659806 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-468d6ead-dfd2-42e9-a6f8-dde7a58ac4cc tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:08.660680 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-fee5c86e-3581-4271-ae15-16cfc59dd265 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.202439 Aug 03 13:02:08.661278 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 185/390] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:08 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:02:08.787631 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-468d6ead-dfd2-42e9-a6f8-dde7a58ac4cc tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:08.795067 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-468d6ead-dfd2-42e9-a6f8-dde7a58ac4cc tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1503 microversion: 2.1 time: 0.149734 Aug 03 13:02:08.795624 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 206/391] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:08 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:09.663479 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-61c93129-f002-4f1e-be75-65f8c857b7b6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:09.664132 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-61c93129-f002-4f1e-be75-65f8c857b7b6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:09.670749 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-61c93129-f002-4f1e-be75-65f8c857b7b6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:09.671209 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-61c93129-f002-4f1e-be75-65f8c857b7b6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:09.671962 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-61c93129-f002-4f1e-be75-65f8c857b7b6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:09.672385 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-61c93129-f002-4f1e-be75-65f8c857b7b6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:09.680878 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-0a32573e-790c-49f1-a3c5-5d8086df53e9 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:09.682046 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-0a32573e-790c-49f1-a3c5-5d8086df53e9 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:09.693293 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0a32573e-790c-49f1-a3c5-5d8086df53e9 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:09.693293 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0a32573e-790c-49f1-a3c5-5d8086df53e9 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:09.693293 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0a32573e-790c-49f1-a3c5-5d8086df53e9 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:09.693293 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0a32573e-790c-49f1-a3c5-5d8086df53e9 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:09.871634 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-61c93129-f002-4f1e-be75-65f8c857b7b6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:09.879022 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-61c93129-f002-4f1e-be75-65f8c857b7b6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.219338 Aug 03 13:02:09.879584 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 186/392] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:09 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:09.885124 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-0a32573e-790c-49f1-a3c5-5d8086df53e9 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:09.888395 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-5713d44b-c31c-42e9-bb77-0ee11961b623 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:09.889116 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-5713d44b-c31c-42e9-bb77-0ee11961b623 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:09.892777 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-0a32573e-790c-49f1-a3c5-5d8086df53e9 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.215933 Aug 03 13:02:09.893330 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 207/393] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:09 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:02:09.895152 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5713d44b-c31c-42e9-bb77-0ee11961b623 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:09.895600 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5713d44b-c31c-42e9-bb77-0ee11961b623 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:09.896362 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5713d44b-c31c-42e9-bb77-0ee11961b623 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:09.896797 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5713d44b-c31c-42e9-bb77-0ee11961b623 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:10.023108 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-5713d44b-c31c-42e9-bb77-0ee11961b623 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:10.030759 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-5713d44b-c31c-42e9-bb77-0ee11961b623 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1503 microversion: 2.1 time: 0.145902 Aug 03 13:02:10.031319 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 187/394] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:09 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:10.899282 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-678d616c-cb31-428f-a696-caed23f41e02 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:10.899890 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-678d616c-cb31-428f-a696-caed23f41e02 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:10.906182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-678d616c-cb31-428f-a696-caed23f41e02 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:10.906631 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-678d616c-cb31-428f-a696-caed23f41e02 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:10.907421 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-678d616c-cb31-428f-a696-caed23f41e02 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:10.908433 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-678d616c-cb31-428f-a696-caed23f41e02 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:10.914048 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1c2274cf-dc14-48a0-9eea-f7039b903d5f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:10.914757 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-1c2274cf-dc14-48a0-9eea-f7039b903d5f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:10.917246 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=80 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:10.921989 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1c2274cf-dc14-48a0-9eea-f7039b903d5f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:10.922443 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1c2274cf-dc14-48a0-9eea-f7039b903d5f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:10.923243 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1c2274cf-dc14-48a0-9eea-f7039b903d5f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:10.923687 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1c2274cf-dc14-48a0-9eea-f7039b903d5f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:11.110254 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-678d616c-cb31-428f-a696-caed23f41e02 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:11.114610 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-1c2274cf-dc14-48a0-9eea-f7039b903d5f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:11.118396 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-678d616c-cb31-428f-a696-caed23f41e02 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.223069 Aug 03 13:02:11.118991 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 208/395] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:10 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:11.122287 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-1c2274cf-dc14-48a0-9eea-f7039b903d5f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.212002 Aug 03 13:02:11.122960 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 188/396] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:10 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:02:11.123695 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-049ded28-747e-449f-8e3b-d4a4027d138c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:11.124297 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-049ded28-747e-449f-8e3b-d4a4027d138c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:11.130486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-049ded28-747e-449f-8e3b-d4a4027d138c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:11.130974 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-049ded28-747e-449f-8e3b-d4a4027d138c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:11.131737 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-049ded28-747e-449f-8e3b-d4a4027d138c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:11.132174 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-049ded28-747e-449f-8e3b-d4a4027d138c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:11.263179 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-049ded28-747e-449f-8e3b-d4a4027d138c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:11.271523 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-049ded28-747e-449f-8e3b-d4a4027d138c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1503 microversion: 2.1 time: 0.151512 Aug 03 13:02:11.272040 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 209/397] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:11 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:12.140178 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-42a1a46b-3892-41f6-ba39-c71bee90cfac tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:12.140827 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-42a1a46b-3892-41f6-ba39-c71bee90cfac tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:12.143159 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-3616cc63-9bcc-4861-9e04-5e26d5d26e30 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:12.143775 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-3616cc63-9bcc-4861-9e04-5e26d5d26e30 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:12.147598 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-42a1a46b-3892-41f6-ba39-c71bee90cfac tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:12.148043 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-42a1a46b-3892-41f6-ba39-c71bee90cfac tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:12.148812 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-42a1a46b-3892-41f6-ba39-c71bee90cfac tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:12.149243 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-42a1a46b-3892-41f6-ba39-c71bee90cfac tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:12.150317 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3616cc63-9bcc-4861-9e04-5e26d5d26e30 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:12.150809 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3616cc63-9bcc-4861-9e04-5e26d5d26e30 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:12.151759 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3616cc63-9bcc-4861-9e04-5e26d5d26e30 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:12.152368 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3616cc63-9bcc-4861-9e04-5e26d5d26e30 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:12.357199 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-42a1a46b-3892-41f6-ba39-c71bee90cfac tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:12.359973 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-3616cc63-9bcc-4861-9e04-5e26d5d26e30 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:12.365706 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-42a1a46b-3892-41f6-ba39-c71bee90cfac tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.229691 Aug 03 13:02:12.366395 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 189/398] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:12 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:12.367844 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-3616cc63-9bcc-4861-9e04-5e26d5d26e30 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.228450 Aug 03 13:02:12.368391 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 210/399] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:12 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:02:12.371477 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-8d88ff01-956d-4921-86e2-3f42d5fa9836 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:12.372204 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-8d88ff01-956d-4921-86e2-3f42d5fa9836 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:12.378462 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8d88ff01-956d-4921-86e2-3f42d5fa9836 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:12.379116 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8d88ff01-956d-4921-86e2-3f42d5fa9836 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:12.380042 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8d88ff01-956d-4921-86e2-3f42d5fa9836 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:12.380492 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8d88ff01-956d-4921-86e2-3f42d5fa9836 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:12.510756 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-8d88ff01-956d-4921-86e2-3f42d5fa9836 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:12.518777 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-8d88ff01-956d-4921-86e2-3f42d5fa9836 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1503 microversion: 2.1 time: 0.151145 Aug 03 13:02:12.519337 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 190/400] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:12 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:13.386996 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-24788f93-43b3-4e19-930b-012d690fa70d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:13.387702 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-c198baf0-f50c-4cac-9e34-1d1ee239b03e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:13.388827 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-c198baf0-f50c-4cac-9e34-1d1ee239b03e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:13.389312 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-24788f93-43b3-4e19-930b-012d690fa70d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:13.396136 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c198baf0-f50c-4cac-9e34-1d1ee239b03e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:13.396800 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c198baf0-f50c-4cac-9e34-1d1ee239b03e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:13.397353 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-24788f93-43b3-4e19-930b-012d690fa70d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:13.397929 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c198baf0-f50c-4cac-9e34-1d1ee239b03e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:13.398258 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-24788f93-43b3-4e19-930b-012d690fa70d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:13.398708 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c198baf0-f50c-4cac-9e34-1d1ee239b03e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:13.399341 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-24788f93-43b3-4e19-930b-012d690fa70d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:13.399829 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-24788f93-43b3-4e19-930b-012d690fa70d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:13.659583 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c198baf0-f50c-4cac-9e34-1d1ee239b03e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:13.662615 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-24788f93-43b3-4e19-930b-012d690fa70d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:13.668096 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-c198baf0-f50c-4cac-9e34-1d1ee239b03e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.284132 Aug 03 13:02:13.668672 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 191/401] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:13 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:13.670582 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-24788f93-43b3-4e19-930b-012d690fa70d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.287370 Aug 03 13:02:13.670992 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 211/402] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:13 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:13.675124 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-4d7a8a50-eb25-4ea6-b106-1b98783298dc tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:13.675441 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-4d7a8a50-eb25-4ea6-b106-1b98783298dc tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:13.681140 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4d7a8a50-eb25-4ea6-b106-1b98783298dc tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:13.681593 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4d7a8a50-eb25-4ea6-b106-1b98783298dc tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:13.682358 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4d7a8a50-eb25-4ea6-b106-1b98783298dc tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:13.682822 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4d7a8a50-eb25-4ea6-b106-1b98783298dc tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:13.828270 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-4d7a8a50-eb25-4ea6-b106-1b98783298dc tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:13.836270 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-4d7a8a50-eb25-4ea6-b106-1b98783298dc tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1503 microversion: 2.1 time: 0.166583 Aug 03 13:02:13.836837 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 192/403] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:13 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:14.694944 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-7d0ea7d1-a5c3-497a-94ac-ed3ae6a162a3 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:14.699405 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-38d88db2-2c33-497e-b8ad-a3f58e32d9cd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:14.699854 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-7d0ea7d1-a5c3-497a-94ac-ed3ae6a162a3 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:14.699976 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-38d88db2-2c33-497e-b8ad-a3f58e32d9cd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:14.702777 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7d0ea7d1-a5c3-497a-94ac-ed3ae6a162a3 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:14.703237 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-38d88db2-2c33-497e-b8ad-a3f58e32d9cd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:14.703353 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7d0ea7d1-a5c3-497a-94ac-ed3ae6a162a3 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:14.703691 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-38d88db2-2c33-497e-b8ad-a3f58e32d9cd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:14.704181 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7d0ea7d1-a5c3-497a-94ac-ed3ae6a162a3 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:14.704449 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-38d88db2-2c33-497e-b8ad-a3f58e32d9cd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:14.704724 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7d0ea7d1-a5c3-497a-94ac-ed3ae6a162a3 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:14.705053 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-38d88db2-2c33-497e-b8ad-a3f58e32d9cd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:14.902006 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-7d0ea7d1-a5c3-497a-94ac-ed3ae6a162a3 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:14.909857 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-7d0ea7d1-a5c3-497a-94ac-ed3ae6a162a3 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.218832 Aug 03 13:02:14.910414 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 212/404] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:14 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:14.919124 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-38d88db2-2c33-497e-b8ad-a3f58e32d9cd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:14.921495 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-7b5bfd22-74e3-423b-be07-df894cd20761 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:14.922268 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-7b5bfd22-74e3-423b-be07-df894cd20761 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:14.927320 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-38d88db2-2c33-497e-b8ad-a3f58e32d9cd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.236039 Aug 03 13:02:14.927893 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 193/405] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:14 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:14.928446 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7b5bfd22-74e3-423b-be07-df894cd20761 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:14.928967 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7b5bfd22-74e3-423b-be07-df894cd20761 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:14.929745 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7b5bfd22-74e3-423b-be07-df894cd20761 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:14.930178 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7b5bfd22-74e3-423b-be07-df894cd20761 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:15.080418 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-7b5bfd22-74e3-423b-be07-df894cd20761 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:15.096477 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-7b5bfd22-74e3-423b-be07-df894cd20761 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1503 microversion: 2.1 time: 0.179633 Aug 03 13:02:15.097041 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 213/406] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:14 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1503 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:15.930576 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-72529bd3-a8bb-416b-b09e-2e5dc42cf058 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:15.931274 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-72529bd3-a8bb-416b-b09e-2e5dc42cf058 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:15.937753 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-72529bd3-a8bb-416b-b09e-2e5dc42cf058 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:15.938204 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-72529bd3-a8bb-416b-b09e-2e5dc42cf058 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:15.938997 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-72529bd3-a8bb-416b-b09e-2e5dc42cf058 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:15.939433 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-72529bd3-a8bb-416b-b09e-2e5dc42cf058 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:15.948444 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-be8e9a04-232c-4cee-b8f1-d137ec5c2d4e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:15.949062 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-be8e9a04-232c-4cee-b8f1-d137ec5c2d4e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:15.955127 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-be8e9a04-232c-4cee-b8f1-d137ec5c2d4e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:15.956077 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-be8e9a04-232c-4cee-b8f1-d137ec5c2d4e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:15.956839 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-be8e9a04-232c-4cee-b8f1-d137ec5c2d4e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:15.957271 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-be8e9a04-232c-4cee-b8f1-d137ec5c2d4e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:16.131877 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-72529bd3-a8bb-416b-b09e-2e5dc42cf058 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:16.140377 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-72529bd3-a8bb-416b-b09e-2e5dc42cf058 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.213414 Aug 03 13:02:16.141052 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 194/407] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:15 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:16.146355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-45c60b0d-5ba5-4272-92e3-8629f271d07d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:16.147011 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-45c60b0d-5ba5-4272-92e3-8629f271d07d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:16.154531 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-be8e9a04-232c-4cee-b8f1-d137ec5c2d4e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:16.163486 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-45c60b0d-5ba5-4272-92e3-8629f271d07d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:16.163933 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-45c60b0d-5ba5-4272-92e3-8629f271d07d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:16.164486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-be8e9a04-232c-4cee-b8f1-d137ec5c2d4e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.219668 Aug 03 13:02:16.164694 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-45c60b0d-5ba5-4272-92e3-8629f271d07d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:16.165123 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-45c60b0d-5ba5-4272-92e3-8629f271d07d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:16.175265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 214/408] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:15 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:02:16.294798 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-45c60b0d-5ba5-4272-92e3-8629f271d07d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:16.302750 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-45c60b0d-5ba5-4272-92e3-8629f271d07d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1503 microversion: 2.1 time: 0.160516 Aug 03 13:02:16.303319 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 195/409] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:16 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:17.161081 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-73b6d352-f1b5-4f33-8016-cd35f6a97b54 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:17.161692 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-73b6d352-f1b5-4f33-8016-cd35f6a97b54 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:17.167812 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-73b6d352-f1b5-4f33-8016-cd35f6a97b54 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:17.168264 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-73b6d352-f1b5-4f33-8016-cd35f6a97b54 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:17.169020 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-73b6d352-f1b5-4f33-8016-cd35f6a97b54 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:17.169465 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-73b6d352-f1b5-4f33-8016-cd35f6a97b54 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:17.173557 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:17.185554 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-5af609e5-43a2-47a5-8a22-6e954fd693a5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:17.186187 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-5af609e5-43a2-47a5-8a22-6e954fd693a5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:17.200584 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5af609e5-43a2-47a5-8a22-6e954fd693a5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:17.200584 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5af609e5-43a2-47a5-8a22-6e954fd693a5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:17.200584 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5af609e5-43a2-47a5-8a22-6e954fd693a5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:17.200584 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5af609e5-43a2-47a5-8a22-6e954fd693a5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:17.373182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-73b6d352-f1b5-4f33-8016-cd35f6a97b54 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:17.376442 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-5af609e5-43a2-47a5-8a22-6e954fd693a5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:17.381305 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-73b6d352-f1b5-4f33-8016-cd35f6a97b54 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.224130 Aug 03 13:02:17.381949 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 215/410] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:17 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:17.394197 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-5af609e5-43a2-47a5-8a22-6e954fd693a5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.203336 Aug 03 13:02:17.394197 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 196/411] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:17 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:02:17.394431 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-151cc27f-54ad-4250-858a-7b0d90ce555e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:17.394431 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-151cc27f-54ad-4250-858a-7b0d90ce555e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:17.394431 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-151cc27f-54ad-4250-858a-7b0d90ce555e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:17.394431 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-151cc27f-54ad-4250-858a-7b0d90ce555e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:17.394695 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-151cc27f-54ad-4250-858a-7b0d90ce555e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:17.394848 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-151cc27f-54ad-4250-858a-7b0d90ce555e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:17.527774 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-151cc27f-54ad-4250-858a-7b0d90ce555e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:17.536072 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-151cc27f-54ad-4250-858a-7b0d90ce555e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1503 microversion: 2.1 time: 0.153108 Aug 03 13:02:17.536638 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 216/412] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:17 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:18.402904 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-a8faf154-6f54-4435-ad3a-5cec81cac04d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:18.403522 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-a8faf154-6f54-4435-ad3a-5cec81cac04d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:18.405310 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-66b5e498-bb7a-4e72-9f5e-7ce72cd33704 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:18.405918 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-66b5e498-bb7a-4e72-9f5e-7ce72cd33704 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:18.410578 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a8faf154-6f54-4435-ad3a-5cec81cac04d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:18.411019 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a8faf154-6f54-4435-ad3a-5cec81cac04d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:18.411786 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a8faf154-6f54-4435-ad3a-5cec81cac04d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:18.411925 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-66b5e498-bb7a-4e72-9f5e-7ce72cd33704 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:18.412223 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a8faf154-6f54-4435-ad3a-5cec81cac04d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:18.412325 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-66b5e498-bb7a-4e72-9f5e-7ce72cd33704 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:18.413068 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-66b5e498-bb7a-4e72-9f5e-7ce72cd33704 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:18.413498 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-66b5e498-bb7a-4e72-9f5e-7ce72cd33704 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:18.602570 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-a8faf154-6f54-4435-ad3a-5cec81cac04d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:18.606638 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-66b5e498-bb7a-4e72-9f5e-7ce72cd33704 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:18.610617 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-a8faf154-6f54-4435-ad3a-5cec81cac04d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.211603 Aug 03 13:02:18.611229 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 197/413] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:18 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:18.616556 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-66b5e498-bb7a-4e72-9f5e-7ce72cd33704 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.215229 Aug 03 13:02:18.617109 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 217/414] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:18 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:02:18.617238 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-8f921390-8164-411f-a279-97bb9dd6ff32 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:18.617984 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-8f921390-8164-411f-a279-97bb9dd6ff32 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:18.624215 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8f921390-8164-411f-a279-97bb9dd6ff32 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:18.624765 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8f921390-8164-411f-a279-97bb9dd6ff32 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:18.625622 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8f921390-8164-411f-a279-97bb9dd6ff32 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:18.626057 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8f921390-8164-411f-a279-97bb9dd6ff32 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:18.750916 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-8f921390-8164-411f-a279-97bb9dd6ff32 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:18.758290 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-8f921390-8164-411f-a279-97bb9dd6ff32 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1503 microversion: 2.1 time: 0.144828 Aug 03 13:02:18.758873 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 198/415] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:18 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:19.633920 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-443e39d2-554b-49dd-adab-dcfd213aafff tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:19.635184 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-443e39d2-554b-49dd-adab-dcfd213aafff tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:19.636534 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-14ef89bd-6547-44c9-8681-f91ac5e4a3db tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:19.637148 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-14ef89bd-6547-44c9-8681-f91ac5e4a3db tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:19.641520 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-443e39d2-554b-49dd-adab-dcfd213aafff tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:19.641971 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-443e39d2-554b-49dd-adab-dcfd213aafff tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:19.642754 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-443e39d2-554b-49dd-adab-dcfd213aafff tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:19.643931 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-443e39d2-554b-49dd-adab-dcfd213aafff tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:19.644216 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-14ef89bd-6547-44c9-8681-f91ac5e4a3db tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:19.644662 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-14ef89bd-6547-44c9-8681-f91ac5e4a3db tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:19.645455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-14ef89bd-6547-44c9-8681-f91ac5e4a3db tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:19.645887 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-14ef89bd-6547-44c9-8681-f91ac5e4a3db tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:19.837642 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-443e39d2-554b-49dd-adab-dcfd213aafff tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:19.843477 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-14ef89bd-6547-44c9-8681-f91ac5e4a3db tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:19.845543 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-443e39d2-554b-49dd-adab-dcfd213aafff tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.215899 Aug 03 13:02:19.846299 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 218/416] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:19 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:19.850723 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-3990be79-1a89-463d-9bb0-c7b70810308e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:19.851370 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-3990be79-1a89-463d-9bb0-c7b70810308e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:19.851975 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-14ef89bd-6547-44c9-8681-f91ac5e4a3db tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.219435 Aug 03 13:02:19.854033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 199/417] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:19 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:02:19.857914 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3990be79-1a89-463d-9bb0-c7b70810308e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:19.858520 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3990be79-1a89-463d-9bb0-c7b70810308e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:19.859342 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3990be79-1a89-463d-9bb0-c7b70810308e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:19.859776 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3990be79-1a89-463d-9bb0-c7b70810308e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:19.990676 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-3990be79-1a89-463d-9bb0-c7b70810308e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:19.998562 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-3990be79-1a89-463d-9bb0-c7b70810308e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1503 microversion: 2.1 time: 0.151301 Aug 03 13:02:19.999260 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 219/418] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:19 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:20.866437 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-c7e7124d-a2bb-406f-85db-b3d9ca96fe01 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:20.867093 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-c7e7124d-a2bb-406f-85db-b3d9ca96fe01 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:20.873170 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-04bb2c95-1a5f-4148-be32-cca31b9c8696 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:20.873750 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c7e7124d-a2bb-406f-85db-b3d9ca96fe01 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:20.873934 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-04bb2c95-1a5f-4148-be32-cca31b9c8696 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:20.874201 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c7e7124d-a2bb-406f-85db-b3d9ca96fe01 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:20.874994 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c7e7124d-a2bb-406f-85db-b3d9ca96fe01 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:20.875454 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c7e7124d-a2bb-406f-85db-b3d9ca96fe01 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:20.881127 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-04bb2c95-1a5f-4148-be32-cca31b9c8696 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:20.881127 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-04bb2c95-1a5f-4148-be32-cca31b9c8696 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:20.881812 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-04bb2c95-1a5f-4148-be32-cca31b9c8696 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:20.882243 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-04bb2c95-1a5f-4148-be32-cca31b9c8696 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:21.074280 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-04bb2c95-1a5f-4148-be32-cca31b9c8696 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:21.083092 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-04bb2c95-1a5f-4148-be32-cca31b9c8696 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.213572 Aug 03 13:02:21.083686 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 220/419] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:20 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:21.088626 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-41c421cf-d7e5-4b24-9d90-f53d09c760ab tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:21.089369 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-41c421cf-d7e5-4b24-9d90-f53d09c760ab tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:21.093599 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c7e7124d-a2bb-406f-85db-b3d9ca96fe01 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:21.095587 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-41c421cf-d7e5-4b24-9d90-f53d09c760ab tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:21.096026 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-41c421cf-d7e5-4b24-9d90-f53d09c760ab tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:21.096793 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-41c421cf-d7e5-4b24-9d90-f53d09c760ab tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:21.097245 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-41c421cf-d7e5-4b24-9d90-f53d09c760ab tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:21.101649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-c7e7124d-a2bb-406f-85db-b3d9ca96fe01 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.239034 Aug 03 13:02:21.102217 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 200/420] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:20 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:21.247216 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-41c421cf-d7e5-4b24-9d90-f53d09c760ab tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:21.255765 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-41c421cf-d7e5-4b24-9d90-f53d09c760ab tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1503 microversion: 2.1 time: 0.170937 Aug 03 13:02:21.256335 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 221/421] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:21 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:22.107383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-9bdfd2d5-3710-41cf-bf46-babb3259c6c6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:22.107986 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-9bdfd2d5-3710-41cf-bf46-babb3259c6c6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:22.114375 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9bdfd2d5-3710-41cf-bf46-babb3259c6c6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:22.114887 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9bdfd2d5-3710-41cf-bf46-babb3259c6c6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:22.115642 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9bdfd2d5-3710-41cf-bf46-babb3259c6c6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:22.116082 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9bdfd2d5-3710-41cf-bf46-babb3259c6c6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:22.122760 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-13a7268d-ec98-4939-920e-ae2e09258130 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:22.123383 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-13a7268d-ec98-4939-920e-ae2e09258130 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:22.129384 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-13a7268d-ec98-4939-920e-ae2e09258130 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:22.129835 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-13a7268d-ec98-4939-920e-ae2e09258130 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:22.130600 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-13a7268d-ec98-4939-920e-ae2e09258130 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:22.130825 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=100 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:22.131124 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-13a7268d-ec98-4939-920e-ae2e09258130 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:22.316834 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-9bdfd2d5-3710-41cf-bf46-babb3259c6c6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:22.320719 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-13a7268d-ec98-4939-920e-ae2e09258130 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:22.324467 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-9bdfd2d5-3710-41cf-bf46-babb3259c6c6 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.220832 Aug 03 13:02:22.329427 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 201/422] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:22 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:22.329427 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-94a5c8cf-25a9-466b-b9d7-7679443ac1a2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:22.330131 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-94a5c8cf-25a9-466b-b9d7-7679443ac1a2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:22.336938 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-13a7268d-ec98-4939-920e-ae2e09258130 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.218195 Aug 03 13:02:22.338771 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-94a5c8cf-25a9-466b-b9d7-7679443ac1a2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:22.338771 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-94a5c8cf-25a9-466b-b9d7-7679443ac1a2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:22.339059 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-94a5c8cf-25a9-466b-b9d7-7679443ac1a2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:22.339501 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-94a5c8cf-25a9-466b-b9d7-7679443ac1a2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:22.343233 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 222/423] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:22 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:02:22.467817 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-94a5c8cf-25a9-466b-b9d7-7679443ac1a2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:22.476487 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-94a5c8cf-25a9-466b-b9d7-7679443ac1a2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1503 microversion: 2.1 time: 0.150486 Aug 03 13:02:22.479605 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 202/424] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:22 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:23.346366 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-0b8fd277-8f95-4950-9506-965221fd2c70 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:23.346945 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-0b8fd277-8f95-4950-9506-965221fd2c70 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:23.352958 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0b8fd277-8f95-4950-9506-965221fd2c70 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:23.353402 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0b8fd277-8f95-4950-9506-965221fd2c70 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:23.354159 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0b8fd277-8f95-4950-9506-965221fd2c70 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:23.354588 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0b8fd277-8f95-4950-9506-965221fd2c70 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:23.357113 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-646d5b01-ea92-45e0-920c-e3feb534018e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:23.357730 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-646d5b01-ea92-45e0-920c-e3feb534018e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:23.364416 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-646d5b01-ea92-45e0-920c-e3feb534018e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:23.364876 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-646d5b01-ea92-45e0-920c-e3feb534018e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:23.365723 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-646d5b01-ea92-45e0-920c-e3feb534018e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:23.366140 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-646d5b01-ea92-45e0-920c-e3feb534018e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:23.556054 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-0b8fd277-8f95-4950-9506-965221fd2c70 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:23.560767 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-646d5b01-ea92-45e0-920c-e3feb534018e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:23.563791 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-0b8fd277-8f95-4950-9506-965221fd2c70 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.221389 Aug 03 13:02:23.564680 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 223/425] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:23 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:23.569069 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-646d5b01-ea92-45e0-920c-e3feb534018e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.215687 Aug 03 13:02:23.569636 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 203/426] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:23 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:02:23.570242 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-e86d1a3d-38c1-4411-8f5d-041402736874 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:23.570952 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-e86d1a3d-38c1-4411-8f5d-041402736874 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:23.576870 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e86d1a3d-38c1-4411-8f5d-041402736874 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:23.577380 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e86d1a3d-38c1-4411-8f5d-041402736874 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:23.578322 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e86d1a3d-38c1-4411-8f5d-041402736874 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:23.578775 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e86d1a3d-38c1-4411-8f5d-041402736874 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:23.703761 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-e86d1a3d-38c1-4411-8f5d-041402736874 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:23.711427 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-e86d1a3d-38c1-4411-8f5d-041402736874 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1503 microversion: 2.1 time: 0.145562 Aug 03 13:02:23.711988 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 224/427] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:23 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:24.586480 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e41bf9c1-0ee8-49c9-b7f4-f8410afbf000 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:24.587245 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-e41bf9c1-0ee8-49c9-b7f4-f8410afbf000 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:24.589497 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-c290e359-bc6b-45d2-837d-615336d5072e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:24.590370 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-c290e359-bc6b-45d2-837d-615336d5072e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:24.594228 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e41bf9c1-0ee8-49c9-b7f4-f8410afbf000 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:24.594681 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e41bf9c1-0ee8-49c9-b7f4-f8410afbf000 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:24.595473 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e41bf9c1-0ee8-49c9-b7f4-f8410afbf000 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:24.595911 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e41bf9c1-0ee8-49c9-b7f4-f8410afbf000 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:24.596679 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c290e359-bc6b-45d2-837d-615336d5072e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:24.597149 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c290e359-bc6b-45d2-837d-615336d5072e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:24.597902 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c290e359-bc6b-45d2-837d-615336d5072e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:24.598512 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c290e359-bc6b-45d2-837d-615336d5072e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:24.793915 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-e41bf9c1-0ee8-49c9-b7f4-f8410afbf000 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:24.796725 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-c290e359-bc6b-45d2-837d-615336d5072e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:24.801598 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-e41bf9c1-0ee8-49c9-b7f4-f8410afbf000 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.219125 Aug 03 13:02:24.802246 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 204/428] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:24 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:24.804044 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-c290e359-bc6b-45d2-837d-615336d5072e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.218733 Aug 03 13:02:24.804862 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 225/429] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:24 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:02:24.810302 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e96a891d-5f14-4949-976e-1037a483c1f5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:24.811031 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-e96a891d-5f14-4949-976e-1037a483c1f5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:24.817677 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e96a891d-5f14-4949-976e-1037a483c1f5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:24.818128 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e96a891d-5f14-4949-976e-1037a483c1f5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:24.818925 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e96a891d-5f14-4949-976e-1037a483c1f5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:24.819364 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e96a891d-5f14-4949-976e-1037a483c1f5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:24.950032 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-e96a891d-5f14-4949-976e-1037a483c1f5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:24.957416 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-e96a891d-5f14-4949-976e-1037a483c1f5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1503 microversion: 2.1 time: 0.154216 Aug 03 13:02:24.957977 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 205/430] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:24 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:25.824008 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-b782d3aa-ae25-417a-b0b1-fc55857da84d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:25.824554 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-b782d3aa-ae25-417a-b0b1-fc55857da84d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:25.824650 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-425d14ac-7bef-4454-b8e4-82030101e165 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:25.825170 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-425d14ac-7bef-4454-b8e4-82030101e165 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:25.830669 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b782d3aa-ae25-417a-b0b1-fc55857da84d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:25.831172 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b782d3aa-ae25-417a-b0b1-fc55857da84d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:25.831661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-425d14ac-7bef-4454-b8e4-82030101e165 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:25.831959 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b782d3aa-ae25-417a-b0b1-fc55857da84d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:25.832137 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-425d14ac-7bef-4454-b8e4-82030101e165 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:25.832479 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b782d3aa-ae25-417a-b0b1-fc55857da84d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:25.832881 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-425d14ac-7bef-4454-b8e4-82030101e165 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:25.833386 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-425d14ac-7bef-4454-b8e4-82030101e165 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:26.027890 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b782d3aa-ae25-417a-b0b1-fc55857da84d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:26.031872 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-425d14ac-7bef-4454-b8e4-82030101e165 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:26.036228 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-b782d3aa-ae25-417a-b0b1-fc55857da84d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.216360 Aug 03 13:02:26.036988 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 226/431] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:25 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:26.041339 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-cfa774fd-fa80-46e3-a4c5-9e86bd85bdd6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:26.042141 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-cfa774fd-fa80-46e3-a4c5-9e86bd85bdd6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:26.042908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-425d14ac-7bef-4454-b8e4-82030101e165 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.221933 Aug 03 13:02:26.043477 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 206/432] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:25 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:02:26.048095 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-cfa774fd-fa80-46e3-a4c5-9e86bd85bdd6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:26.056178 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-cfa774fd-fa80-46e3-a4c5-9e86bd85bdd6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:26.056178 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-cfa774fd-fa80-46e3-a4c5-9e86bd85bdd6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:26.056178 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-cfa774fd-fa80-46e3-a4c5-9e86bd85bdd6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:26.180092 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-cfa774fd-fa80-46e3-a4c5-9e86bd85bdd6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:26.187631 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-cfa774fd-fa80-46e3-a4c5-9e86bd85bdd6 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1503 microversion: 2.1 time: 0.149837 Aug 03 13:02:26.188195 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 227/433] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:26 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:27.057027 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1921750f-713a-4a4b-811f-ce811dfb7130 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:27.057634 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-1921750f-713a-4a4b-811f-ce811dfb7130 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:27.064290 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1921750f-713a-4a4b-811f-ce811dfb7130 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:27.064743 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1921750f-713a-4a4b-811f-ce811dfb7130 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:27.065509 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1921750f-713a-4a4b-811f-ce811dfb7130 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:27.065961 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1921750f-713a-4a4b-811f-ce811dfb7130 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:27.074930 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-66b67163-d328-4b9b-970a-65846348cd9f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:27.075674 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-66b67163-d328-4b9b-970a-65846348cd9f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:27.082332 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-66b67163-d328-4b9b-970a-65846348cd9f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:27.082802 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-66b67163-d328-4b9b-970a-65846348cd9f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:27.083583 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-66b67163-d328-4b9b-970a-65846348cd9f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:27.084016 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-66b67163-d328-4b9b-970a-65846348cd9f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:27.275770 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-1921750f-713a-4a4b-811f-ce811dfb7130 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:27.285613 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-1921750f-713a-4a4b-811f-ce811dfb7130 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.232437 Aug 03 13:02:27.286397 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 207/434] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:27 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:27.292068 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-ad9d7305-8191-4d85-b2cb-e7c0d0878c47 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:27.292670 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-ad9d7305-8191-4d85-b2cb-e7c0d0878c47 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:27.298757 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ad9d7305-8191-4d85-b2cb-e7c0d0878c47 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:27.299229 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ad9d7305-8191-4d85-b2cb-e7c0d0878c47 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:27.302202 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ad9d7305-8191-4d85-b2cb-e7c0d0878c47 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:27.302202 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ad9d7305-8191-4d85-b2cb-e7c0d0878c47 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:27.304278 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-66b67163-d328-4b9b-970a-65846348cd9f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:27.315263 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-66b67163-d328-4b9b-970a-65846348cd9f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.241586 Aug 03 13:02:27.315263 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 228/435] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:27 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:02:27.435374 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ad9d7305-8191-4d85-b2cb-e7c0d0878c47 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:27.442849 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-ad9d7305-8191-4d85-b2cb-e7c0d0878c47 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1503 microversion: 2.1 time: 0.154790 Aug 03 13:02:27.443413 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 208/436] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:27 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:28.307292 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-2a93635c-9df8-47d5-b544-559927446e7a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:28.307905 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-2a93635c-9df8-47d5-b544-559927446e7a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:28.313961 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2a93635c-9df8-47d5-b544-559927446e7a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:28.314476 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2a93635c-9df8-47d5-b544-559927446e7a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:28.315213 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2a93635c-9df8-47d5-b544-559927446e7a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:28.315649 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2a93635c-9df8-47d5-b544-559927446e7a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:28.336475 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-37dd4306-48d2-4888-b0c3-36a57a56490d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:28.337521 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-37dd4306-48d2-4888-b0c3-36a57a56490d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:28.344069 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-37dd4306-48d2-4888-b0c3-36a57a56490d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:28.345590 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-37dd4306-48d2-4888-b0c3-36a57a56490d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:28.347176 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-37dd4306-48d2-4888-b0c3-36a57a56490d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:28.349151 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-37dd4306-48d2-4888-b0c3-36a57a56490d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:28.531476 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-2a93635c-9df8-47d5-b544-559927446e7a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:28.538175 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-37dd4306-48d2-4888-b0c3-36a57a56490d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:28.539946 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-2a93635c-9df8-47d5-b544-559927446e7a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.236638 Aug 03 13:02:28.540689 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 229/437] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:28 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:02:28.545046 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-1e945b0d-936a-4dcd-b6f1-27b38ac6a66c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:28.545667 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-1e945b0d-936a-4dcd-b6f1-27b38ac6a66c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:28.546502 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-37dd4306-48d2-4888-b0c3-36a57a56490d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1359 microversion: 2.1 time: 0.213904 Aug 03 13:02:28.552136 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1e945b0d-936a-4dcd-b6f1-27b38ac6a66c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:28.552574 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1e945b0d-936a-4dcd-b6f1-27b38ac6a66c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:28.553503 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1e945b0d-936a-4dcd-b6f1-27b38ac6a66c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:28.553926 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1e945b0d-936a-4dcd-b6f1-27b38ac6a66c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:28.556681 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 209/438] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:28 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1359 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:28.698274 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-1e945b0d-936a-4dcd-b6f1-27b38ac6a66c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:28.706341 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-1e945b0d-936a-4dcd-b6f1-27b38ac6a66c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1503 microversion: 2.1 time: 0.164690 Aug 03 13:02:28.706989 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 230/439] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:28 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:29.562130 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-4f89c34a-29f9-41d5-ac16-6dc6a7234112 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:29.562750 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-4f89c34a-29f9-41d5-ac16-6dc6a7234112 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:29.569558 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-b8f909ee-0c4d-4567-a700-4d3cd8a088f1 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:29.570005 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4f89c34a-29f9-41d5-ac16-6dc6a7234112 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:29.570161 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-b8f909ee-0c4d-4567-a700-4d3cd8a088f1 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:29.570291 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4f89c34a-29f9-41d5-ac16-6dc6a7234112 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:29.571078 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4f89c34a-29f9-41d5-ac16-6dc6a7234112 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:29.571508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4f89c34a-29f9-41d5-ac16-6dc6a7234112 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:29.575941 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b8f909ee-0c4d-4567-a700-4d3cd8a088f1 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:29.576385 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b8f909ee-0c4d-4567-a700-4d3cd8a088f1 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:29.577130 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b8f909ee-0c4d-4567-a700-4d3cd8a088f1 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:29.577553 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b8f909ee-0c4d-4567-a700-4d3cd8a088f1 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:29.973823 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b8f909ee-0c4d-4567-a700-4d3cd8a088f1 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:29.976683 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-4f89c34a-29f9-41d5-ac16-6dc6a7234112 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:29.977157 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=100 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:29.981501 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-b8f909ee-0c4d-4567-a700-4d3cd8a088f1 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1549 microversion: 2.1 time: 0.416323 Aug 03 13:02:29.985750 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 231/440] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:29 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1549 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:02:29.985898 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-4f89c34a-29f9-41d5-ac16-6dc6a7234112 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.425946 Aug 03 13:02:29.985898 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 210/441] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:29 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:29.990507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-8ad2642c-1ac7-40b3-bdb2-03143c51f9c5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:29.991193 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-8ad2642c-1ac7-40b3-bdb2-03143c51f9c5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:29.993070 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:29.997809 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8ad2642c-1ac7-40b3-bdb2-03143c51f9c5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:29.998263 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8ad2642c-1ac7-40b3-bdb2-03143c51f9c5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:29.999078 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8ad2642c-1ac7-40b3-bdb2-03143c51f9c5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:29.999515 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8ad2642c-1ac7-40b3-bdb2-03143c51f9c5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:30.003273 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-287f7398-146a-49f2-8042-583b8b49bc05 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:30.004015 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-287f7398-146a-49f2-8042-583b8b49bc05 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:30.010663 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-287f7398-146a-49f2-8042-583b8b49bc05 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:30.011207 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-287f7398-146a-49f2-8042-583b8b49bc05 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:30.012207 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-287f7398-146a-49f2-8042-583b8b49bc05 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:30.012637 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-287f7398-146a-49f2-8042-583b8b49bc05 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:30.212842 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-8ad2642c-1ac7-40b3-bdb2-03143c51f9c5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:30.216559 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-287f7398-146a-49f2-8042-583b8b49bc05 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:30.221298 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-8ad2642c-1ac7-40b3-bdb2-03143c51f9c5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1503 microversion: 2.1 time: 0.237881 Aug 03 13:02:30.221834 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 232/442] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:29 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1503 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:30.224561 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-287f7398-146a-49f2-8042-583b8b49bc05 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1549 microversion: 2.1 time: 0.224962 Aug 03 13:02:30.225115 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 211/443] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:29 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1549 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:30.226427 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-c7de2ed5-debb-42ab-89f5-cd89039a43bb req-edb3447c-acc2-4132-9e6e-67f2eb108afc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fbd50d5-080f-4c14-9818-ffc2af5956d0", "name": "network-vif-unplugged", "status": "completed", "tag": "e45249a4-bda3-4953-980d-920f4eafb8c3"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:02:30.235710 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-c7de2ed5-debb-42ab-89f5-cd89039a43bb req-edb3447c-acc2-4132-9e6e-67f2eb108afc service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:30.236148 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-c7de2ed5-debb-42ab-89f5-cd89039a43bb req-edb3447c-acc2-4132-9e6e-67f2eb108afc service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:30.243751 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d43fd32e-6dd8-4aa7-87de-94f488c669be tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:30.247295 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-c7de2ed5-debb-42ab-89f5-cd89039a43bb req-edb3447c-acc2-4132-9e6e-67f2eb108afc service nova] Creating event network-vif-unplugged:e45249a4-bda3-4953-980d-920f4eafb8c3 for instance 8fbd50d5-080f-4c14-9818-ffc2af5956d0 on hv-cinder-85083 Aug 03 13:02:30.248446 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d43fd32e-6dd8-4aa7-87de-94f488c669be tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:30.249200 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d43fd32e-6dd8-4aa7-87de-94f488c669be tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Searching by: {'deleted': False, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e'} {{(pid=119410) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 13:02:30.252311 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-c7de2ed5-debb-42ab-89f5-cd89039a43bb req-edb3447c-acc2-4132-9e6e-67f2eb108afc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029221 Aug 03 13:02:30.253099 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 233/444] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:02:30.256987 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d43fd32e-6dd8-4aa7-87de-94f488c669be tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:30.257514 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d43fd32e-6dd8-4aa7-87de-94f488c669be tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:30.258305 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d43fd32e-6dd8-4aa7-87de-94f488c669be tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:30.258753 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d43fd32e-6dd8-4aa7-87de-94f488c669be tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:30.354243 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.multi_cell_list [None req-d43fd32e-6dd8-4aa7-87de-94f488c669be tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119410) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 13:02:30.449906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d43fd32e-6dd8-4aa7-87de-94f488c669be tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.209939 Aug 03 13:02:30.450879 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 212/445] 10.222.0.64 () {58 vars in 1125 bytes} [Wed Aug 3 13:02:30 2022] GET /compute/v2.1/servers => generated 343 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:02:30.466497 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-f0644687-ffb5-43c0-8f0d-ace8394ae47f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:30.468098 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-f0644687-ffb5-43c0-8f0d-ace8394ae47f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:30.475255 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f0644687-ffb5-43c0-8f0d-ace8394ae47f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:30.475642 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f0644687-ffb5-43c0-8f0d-ace8394ae47f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:30.476473 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f0644687-ffb5-43c0-8f0d-ace8394ae47f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:30.476912 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f0644687-ffb5-43c0-8f0d-ace8394ae47f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:30.625346 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-f0644687-ffb5-43c0-8f0d-ace8394ae47f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:30.633833 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-f0644687-ffb5-43c0-8f0d-ace8394ae47f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1549 microversion: 2.1 time: 0.174162 Aug 03 13:02:30.637584 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 234/446] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:30 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1549 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:31.008572 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-93877d52-0871-4864-b513-49b352259b2d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:31.009226 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-93877d52-0871-4864-b513-49b352259b2d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:31.015592 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-93877d52-0871-4864-b513-49b352259b2d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:31.016048 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-93877d52-0871-4864-b513-49b352259b2d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:31.016820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-93877d52-0871-4864-b513-49b352259b2d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:31.017252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-93877d52-0871-4864-b513-49b352259b2d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:31.164269 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-ec31ccce-b98a-45ae-9c7c-7bba784cffe1 req-9cff2351-eead-49c5-b470-a3e6ecc3dfcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fbd50d5-080f-4c14-9818-ffc2af5956d0", "name": "network-vif-deleted", "tag": "e45249a4-bda3-4953-980d-920f4eafb8c3"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:02:31.174174 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-ec31ccce-b98a-45ae-9c7c-7bba784cffe1 req-9cff2351-eead-49c5-b470-a3e6ecc3dfcd service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:31.174652 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-ec31ccce-b98a-45ae-9c7c-7bba784cffe1 req-9cff2351-eead-49c5-b470-a3e6ecc3dfcd service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:31.181244 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-93877d52-0871-4864-b513-49b352259b2d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:31.188286 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-ec31ccce-b98a-45ae-9c7c-7bba784cffe1 req-9cff2351-eead-49c5-b470-a3e6ecc3dfcd service nova] Creating event network-vif-deleted:e45249a4-bda3-4953-980d-920f4eafb8c3 for instance 8fbd50d5-080f-4c14-9818-ffc2af5956d0 on hv-cinder-85083 Aug 03 13:02:31.188720 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-93877d52-0871-4864-b513-49b352259b2d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1501 microversion: 2.1 time: 0.183963 Aug 03 13:02:31.189284 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 213/447] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:31 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1501 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:31.193465 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-ec31ccce-b98a-45ae-9c7c-7bba784cffe1 req-9cff2351-eead-49c5-b470-a3e6ecc3dfcd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033458 Aug 03 13:02:31.194046 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 235/448] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:02:31.208781 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-30e3ed6d-ac7f-4ab0-b75b-344342b84388 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d2b922e-3611-4fc3-8b95-65ba7fd66459"}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:02:31.214483 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-30e3ed6d-ac7f-4ab0-b75b-344342b84388 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:31.217150 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-30e3ed6d-ac7f-4ab0-b75b-344342b84388 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:31.217602 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-30e3ed6d-ac7f-4ab0-b75b-344342b84388 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:31.218362 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-30e3ed6d-ac7f-4ab0-b75b-344342b84388 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:31.218848 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-30e3ed6d-ac7f-4ab0-b75b-344342b84388 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:31.242762 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.wsgi [None req-30e3ed6d-ac7f-4ab0-b75b-344342b84388 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] HTTP exception thrown: Cannot 'attach_volume' instance b39c466e-0f7f-48d9-accb-da8ecd932142 while it is in vm_state rescued Aug 03 13:02:31.243730 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d0e7b3e8-3d34-4575-940a-c60da5543735 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:31.244436 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-d0e7b3e8-3d34-4575-940a-c60da5543735 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:31.244660 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-30e3ed6d-ac7f-4ab0-b75b-344342b84388 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Request method failure captured: Aug 03 13:02:31.244660 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: request: POST /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142/os-volume_attachments HTTP/1.1 Aug 03 13:02:31.244660 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept: application/json Aug 03 13:02:31.244660 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept-Encoding: identity Aug 03 13:02:31.244660 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Connection: close Aug 03 13:02:31.244660 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Length: 74 Aug 03 13:02:31.244660 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Type: application/json Aug 03 13:02:31.244660 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Host: 10.222.0.64 Aug 03 13:02:31.244660 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Openstack-System-Scope: None Aug 03 13:02:31.244660 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: User-Agent: python-urllib3/1.26.10 Aug 03 13:02:31.244660 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Auth-Token: gAAAAABi6nEyeq1aA1DnWg7YkrE7D7bgGX9PT3-iXVy9M8Ibjz8s_-Ya_DEsxR7W_QOmRw1tPup_D6mHy2sBVRW5GVp8rEJSTe-zvtUT4dMGtJrZFsYShgkC-wDTETwNYIQHR5pBl-lDcgJcvGJPrB8PSIjI-ebaXTKQTexfbZ3prTy1VXvIMP0 Aug 03 13:02:31.244660 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Id: None Aug 03 13:02:31.244660 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Name: None Aug 03 13:02:31.244660 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Identity-Status: Confirmed Aug 03 13:02:31.244660 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Is-Admin-Project: True Aug 03 13:02:31.244660 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Id: default Aug 03 13:02:31.244660 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Name: Default Aug 03 13:02:31.244660 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Id: 6be1056fe005471f83a0633c99c0b349 Aug 03 13:02:31.244660 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1367109722 Aug 03 13:02:31.244660 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Role: member,reader Aug 03 13:02:31.244660 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Roles: member,reader Aug 03 13:02:31.246173 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6be1056fe005471f83a0633c99c0b349"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6be1056fe005471f83a0633c99c0b349"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6be1056fe005471f83a0633c99c0b349"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6be1056fe005471f83a0633c99c0b349", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:02:31.246173 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1367109722 Aug 03 13:02:31.246173 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Id: 6be1056fe005471f83a0633c99c0b349 Aug 03 13:02:31.246173 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1367109722 Aug 03 13:02:31.246173 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User: tempest-ServerRescueNegativeTestJSON-1367109722-project Aug 03 13:02:31.246173 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Id: default Aug 03 13:02:31.246173 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Name: Default Aug 03 13:02:31.246173 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Id: bb5f78a0ee0642c7bbde2ecf34e090d0 Aug 03 13:02:31.246173 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1367109722-project Aug 03 13:02:31.246173 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Aug 03 13:02:31.246173 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: {"volumeAttachment": {"volumeId": "6d2b922e-3611-4fc3-8b95-65ba7fd66459"}} Aug 03 13:02:31.246173 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: method: > Aug 03 13:02:31.247075 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: exception: Cannot 'attach_volume' instance b39c466e-0f7f-48d9-accb-da8ecd932142 while it is in vm_state rescued Aug 03 13:02:31.247075 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: action_args: {'server_id': 'b39c466e-0f7f-48d9-accb-da8ecd932142', 'body': {'volumeAttachment': {'volumeId': '6d2b922e-3611-4fc3-8b95-65ba7fd66459'}}} Aug 03 13:02:31.247075 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:02:31.247075 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:02:31.247075 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 03 13:02:31.247075 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 03 13:02:31.247075 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 13:02:31.247075 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 13:02:31.247075 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 13:02:31.247075 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 13:02:31.247075 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b39c466e-0f7f-48d9-accb-da8ecd932142 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 03 13:02:31.247075 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:02:31.247075 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:02:31.247075 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:02:31.247075 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:02:31.247075 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:02:31.247075 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:02:31.247075 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:02:31.247075 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:02:31.248526 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:02:31.248526 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:02:31.248526 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 13:02:31.248526 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 13:02:31.248526 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 13:02:31.248526 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 13:02:31.248526 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 13:02:31.248526 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 13:02:31.248526 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 03 13:02:31.248526 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 13:02:31.248526 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 13:02:31.248526 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 13:02:31.248526 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b39c466e-0f7f-48d9-accb-da8ecd932142 while it is in vm_state rescued Aug 03 13:02:31.248526 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:02:31.248526 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:02:31.248526 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:02:31.248526 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:02:31.248526 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:02:31.248526 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:02:31.249906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:02:31.249906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:02:31.249906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b39c466e-0f7f-48d9-accb-da8ecd932142 while it is in vm_state rescued Aug 03 13:02:31.249906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:02:31.249906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-30e3ed6d-ac7f-4ab0-b75b-344342b84388 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Returning 409 to user: Cannot 'attach_volume' instance b39c466e-0f7f-48d9-accb-da8ecd932142 while it is in vm_state rescued {{(pid=119410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:02:31.249906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-30e3ed6d-ac7f-4ab0-b75b-344342b84388 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "POST /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041408 Aug 03 13:02:31.249906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 214/449] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Aug 3 13:02:31 2022] POST /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 03 13:02:31.254142 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d0e7b3e8-3d34-4575-940a-c60da5543735 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:31.254899 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d0e7b3e8-3d34-4575-940a-c60da5543735 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:31.255020 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-50612645-033a-4091-9465-e7f5c4f8cb8e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:02:31.255488 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-50612645-033a-4091-9465-e7f5c4f8cb8e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:31.255642 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d0e7b3e8-3d34-4575-940a-c60da5543735 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:31.255845 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d0e7b3e8-3d34-4575-940a-c60da5543735 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:31.262231 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-50612645-033a-4091-9465-e7f5c4f8cb8e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:31.262724 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-50612645-033a-4091-9465-e7f5c4f8cb8e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:31.263641 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-50612645-033a-4091-9465-e7f5c4f8cb8e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:31.264092 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-50612645-033a-4091-9465-e7f5c4f8cb8e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:31.333409 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-d0e7b3e8-3d34-4575-940a-c60da5543735 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:31.341000 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-d0e7b3e8-3d34-4575-940a-c60da5543735 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1461 microversion: 2.1 time: 0.102071 Aug 03 13:02:31.341630 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 236/450] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:31 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1461 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:02:31.461261 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-50612645-033a-4091-9465-e7f5c4f8cb8e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "POST /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142/action" status: 202 len: 0 microversion: 2.1 time: 0.209781 Aug 03 13:02:31.464330 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 215/451] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Aug 3 13:02:31 2022] POST /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 13:02:31.470932 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-3b3aa491-8ff4-4115-9515-50927d4a37a0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:31.471536 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-3b3aa491-8ff4-4115-9515-50927d4a37a0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:31.477990 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3b3aa491-8ff4-4115-9515-50927d4a37a0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:31.478429 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3b3aa491-8ff4-4115-9515-50927d4a37a0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:31.479215 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3b3aa491-8ff4-4115-9515-50927d4a37a0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:31.479641 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3b3aa491-8ff4-4115-9515-50927d4a37a0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:31.618045 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-3b3aa491-8ff4-4115-9515-50927d4a37a0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:31.625705 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-3b3aa491-8ff4-4115-9515-50927d4a37a0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1509 microversion: 2.1 time: 0.158511 Aug 03 13:02:31.626445 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 237/452] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:31 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:32.363953 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e7e4bc4b-2e2f-4d50-b4b9-257a447e8c4f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:32.364649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-e7e4bc4b-2e2f-4d50-b4b9-257a447e8c4f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:32.378106 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e7e4bc4b-2e2f-4d50-b4b9-257a447e8c4f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:32.378804 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e7e4bc4b-2e2f-4d50-b4b9-257a447e8c4f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:32.380487 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e7e4bc4b-2e2f-4d50-b4b9-257a447e8c4f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:32.381098 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e7e4bc4b-2e2f-4d50-b4b9-257a447e8c4f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:32.424557 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e7e4bc4b-2e2f-4d50-b4b9-257a447e8c4f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:32.425275 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e7e4bc4b-2e2f-4d50-b4b9-257a447e8c4f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:32.425724 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-e7e4bc4b-2e2f-4d50-b4b9-257a447e8c4f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lazy-loading 'fault' on Instance uuid 8fbd50d5-080f-4c14-9818-ffc2af5956d0 {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:02:32.479874 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-e7e4bc4b-2e2f-4d50-b4b9-257a447e8c4f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:32.482401 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:32.488965 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-e7e4bc4b-2e2f-4d50-b4b9-257a447e8c4f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 200 len: 1303 microversion: 2.1 time: 0.129836 Aug 03 13:02:32.489552 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 216/453] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:32 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 1303 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:32.648491 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-fc397121-304e-43d6-bc4f-d4fbf6e6781e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:32.649127 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-fc397121-304e-43d6-bc4f-d4fbf6e6781e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:32.655627 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fc397121-304e-43d6-bc4f-d4fbf6e6781e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:32.656094 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fc397121-304e-43d6-bc4f-d4fbf6e6781e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:32.656871 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fc397121-304e-43d6-bc4f-d4fbf6e6781e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:32.657330 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fc397121-304e-43d6-bc4f-d4fbf6e6781e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:32.789168 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-fc397121-304e-43d6-bc4f-d4fbf6e6781e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:32.796607 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-fc397121-304e-43d6-bc4f-d4fbf6e6781e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1509 microversion: 2.1 time: 0.152687 Aug 03 13:02:32.797169 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 238/454] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:32 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:33.510952 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-da80e4ad-52e8-4aa0-b015-664741d8546f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:33.511569 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-da80e4ad-52e8-4aa0-b015-664741d8546f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: 8fbd50d5-080f-4c14-9818-ffc2af5956d0] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:33.519499 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-da80e4ad-52e8-4aa0-b015-664741d8546f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:33.519953 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-da80e4ad-52e8-4aa0-b015-664741d8546f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:33.520757 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-da80e4ad-52e8-4aa0-b015-664741d8546f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:33.521197 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-da80e4ad-52e8-4aa0-b015-664741d8546f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:33.535033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.wsgi [None req-da80e4ad-52e8-4aa0-b015-664741d8546f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] HTTP exception thrown: Instance 8fbd50d5-080f-4c14-9818-ffc2af5956d0 could not be found. Aug 03 13:02:33.536733 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-da80e4ad-52e8-4aa0-b015-664741d8546f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Request method failure captured: Aug 03 13:02:33.536733 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: request: GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 HTTP/1.1 Aug 03 13:02:33.536733 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept: application/json Aug 03 13:02:33.536733 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept-Encoding: identity Aug 03 13:02:33.536733 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Connection: close Aug 03 13:02:33.536733 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Length: 0 Aug 03 13:02:33.536733 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Type: application/json Aug 03 13:02:33.536733 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Host: 10.222.0.64 Aug 03 13:02:33.536733 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Openstack-System-Scope: None Aug 03 13:02:33.536733 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: User-Agent: python-urllib3/1.26.10 Aug 03 13:02:33.536733 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Auth-Token: gAAAAABi6nGMcOcAvHpr7PjcVPlTPIDoTbR-pmZ689KYk1_7V3Ctdt7HK6FzVuELUKU0JA4ttdwYTyogiNzRYlZS1Hzm6lhaTBgFojCdJraEm01gQqZcIr8KQGGL3L5HM__gWQIr5EJNWZ961xx_Mwsma-PhEL0EyQcTiBdhMA_Y3eQdT9Qmms8 Aug 03 13:02:33.536733 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Id: None Aug 03 13:02:33.536733 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Name: None Aug 03 13:02:33.536733 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Identity-Status: Confirmed Aug 03 13:02:33.536733 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Is-Admin-Project: True Aug 03 13:02:33.536733 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Id: default Aug 03 13:02:33.536733 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Name: Default Aug 03 13:02:33.536733 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Id: ef1e829edd5a4a5f8c5133cb5e37c284 Aug 03 13:02:33.536733 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Name: tempest-VolumesActionsTest-1749394077 Aug 03 13:02:33.536733 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Role: member,reader Aug 03 13:02:33.536733 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Roles: member,reader Aug 03 13:02:33.541259 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ef1e829edd5a4a5f8c5133cb5e37c284"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ef1e829edd5a4a5f8c5133cb5e37c284"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ef1e829edd5a4a5f8c5133cb5e37c284"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ef1e829edd5a4a5f8c5133cb5e37c284", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:02:33.541259 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant: tempest-VolumesActionsTest-1749394077 Aug 03 13:02:33.541259 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Id: ef1e829edd5a4a5f8c5133cb5e37c284 Aug 03 13:02:33.541259 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Name: tempest-VolumesActionsTest-1749394077 Aug 03 13:02:33.541259 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User: tempest-VolumesActionsTest-1749394077-project Aug 03 13:02:33.541259 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Id: default Aug 03 13:02:33.541259 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Name: Default Aug 03 13:02:33.541259 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Id: 79fd9e0292fb4ebab755519ecc20235e Aug 03 13:02:33.541259 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Name: tempest-VolumesActionsTest-1749394077-project Aug 03 13:02:33.541259 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: method: > Aug 03 13:02:33.541259 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: exception: Instance 8fbd50d5-080f-4c14-9818-ffc2af5956d0 could not be found. Aug 03 13:02:33.541259 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: action_args: {'id': '8fbd50d5-080f-4c14-9818-ffc2af5956d0'} Aug 03 13:02:33.542010 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:02:33.542010 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:02:33.542010 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:02:33.542010 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:02:33.542010 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:02:33.542010 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:02:33.542010 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:02:33.542010 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:02:33.542010 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:02:33.542010 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:02:33.542010 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fbd50d5-080f-4c14-9818-ffc2af5956d0 could not be found. Aug 03 13:02:33.542010 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:02:33.542010 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:02:33.542010 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:02:33.542010 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:02:33.542010 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:02:33.542010 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:02:33.542010 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:02:33.542010 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:02:33.542010 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:02:33.543191 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:02:33.543191 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:02:33.543191 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:02:33.543191 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:02:33.543191 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:02:33.543191 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:02:33.543191 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:02:33.543191 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fbd50d5-080f-4c14-9818-ffc2af5956d0 could not be found. Aug 03 13:02:33.543191 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:02:33.543191 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:02:33.543191 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:02:33.543191 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:02:33.543191 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:02:33.543191 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:02:33.543191 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:02:33.543191 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:02:33.543191 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fbd50d5-080f-4c14-9818-ffc2af5956d0 could not be found. Aug 03 13:02:33.543191 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:02:33.544230 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-da80e4ad-52e8-4aa0-b015-664741d8546f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Returning 404 to user: Instance 8fbd50d5-080f-4c14-9818-ffc2af5956d0 could not be found. {{(pid=119410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:02:33.544230 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-da80e4ad-52e8-4aa0-b015-664741d8546f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0" status: 404 len: 111 microversion: 2.1 time: 0.031685 Aug 03 13:02:33.544230 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 217/455] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:33 2022] GET /compute/v2.1/servers/8fbd50d5-080f-4c14-9818-ffc2af5956d0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:02:33.818613 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-6625e8cc-65db-4b7c-9b2e-78776e22f6ba tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:33.819992 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-6625e8cc-65db-4b7c-9b2e-78776e22f6ba tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:33.825887 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6625e8cc-65db-4b7c-9b2e-78776e22f6ba tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:33.826344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6625e8cc-65db-4b7c-9b2e-78776e22f6ba tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:33.827148 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6625e8cc-65db-4b7c-9b2e-78776e22f6ba tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:33.827583 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6625e8cc-65db-4b7c-9b2e-78776e22f6ba tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:33.859962 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-ab8114b7-d1ac-4420-9394-4bfa72e7af58 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1249058610", "imageRef": "c0aabcc0-d4af-4f0e-b8a5-d140344fce1f", "flavorRef": "452", "networks": [{"uuid": "f748a05c-8485-47d8-b9fc-d817c3b8bab2"}]}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:02:33.918330 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.network.neutron [None req-ab8114b7-d1ac-4420-9394-4bfa72e7af58 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] validate_networks() for [('f748a05c-8485-47d8-b9fc-d817c3b8bab2', None, None, None, None, None)] {{(pid=119410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 13:02:34.023864 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-6625e8cc-65db-4b7c-9b2e-78776e22f6ba tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:34.031560 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-6625e8cc-65db-4b7c-9b2e-78776e22f6ba tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1509 microversion: 2.1 time: 0.217470 Aug 03 13:02:34.032128 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 239/456] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:33 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:34.313410 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-ab8114b7-d1ac-4420-9394-4bfa72e7af58 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Flavor limits 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 13:02:34.313864 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-ab8114b7-d1ac-4420-9394-4bfa72e7af58 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Image limits 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 13:02:34.314309 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-ab8114b7-d1ac-4420-9394-4bfa72e7af58 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Flavor pref 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 13:02:34.314964 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-ab8114b7-d1ac-4420-9394-4bfa72e7af58 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Image pref 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 13:02:34.315395 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-ab8114b7-d1ac-4420-9394-4bfa72e7af58 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 13:02:34.324869 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ab8114b7-d1ac-4420-9394-4bfa72e7af58 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:34.325318 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ab8114b7-d1ac-4420-9394-4bfa72e7af58 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:34.326126 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ab8114b7-d1ac-4420-9394-4bfa72e7af58 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:34.326561 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ab8114b7-d1ac-4420-9394-4bfa72e7af58 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:34.343154 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.quota [None req-ab8114b7-d1ac-4420-9394-4bfa72e7af58 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Getting quotas for project ef1e829edd5a4a5f8c5133cb5e37c284. Resources: {'instances', 'ram', 'cores'} {{(pid=119410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 13:02:34.347127 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.quota [None req-ab8114b7-d1ac-4420-9394-4bfa72e7af58 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Getting quotas for user 79fd9e0292fb4ebab755519ecc20235e and project ef1e829edd5a4a5f8c5133cb5e37c284. Resources: {'instances', 'ram', 'cores'} {{(pid=119410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 13:02:34.357971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-ab8114b7-d1ac-4420-9394-4bfa72e7af58 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Going to run 1 instances... {{(pid=119410) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 13:02:34.360248 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-ab8114b7-d1ac-4420-9394-4bfa72e7af58 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0aabcc0-d4af-4f0e-b8a5-d140344fce1f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 13:02:34.524055 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-ab8114b7-d1ac-4420-9394-4bfa72e7af58 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.667990 Aug 03 13:02:34.525323 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 218/457] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 3 13:02:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 13:02:34.536702 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-5af2e218-127e-4828-b114-239244b0617a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:34.537317 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-5af2e218-127e-4828-b114-239244b0617a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:34.598507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-5af2e218-127e-4828-b114-239244b0617a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:34.605230 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-5af2e218-127e-4828-b114-239244b0617a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1214 microversion: 2.1 time: 0.072621 Aug 03 13:02:34.606325 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 240/458] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:34 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:34.716896 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e026124c-b8a9-4e35-80b2-0bd1cf6c8d97 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e3bce0f-47ac-45f8-b840-9a44a9486f0d"}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:02:34.719468 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-e026124c-b8a9-4e35-80b2-0bd1cf6c8d97 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:34.727149 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e026124c-b8a9-4e35-80b2-0bd1cf6c8d97 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:34.727798 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e026124c-b8a9-4e35-80b2-0bd1cf6c8d97 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:34.728566 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e026124c-b8a9-4e35-80b2-0bd1cf6c8d97 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:34.728998 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e026124c-b8a9-4e35-80b2-0bd1cf6c8d97 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:35.052452 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-48accfa0-57fc-4c62-8670-c3dc1248a513 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:35.053196 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-48accfa0-57fc-4c62-8670-c3dc1248a513 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:35.059259 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-48accfa0-57fc-4c62-8670-c3dc1248a513 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:35.059704 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-48accfa0-57fc-4c62-8670-c3dc1248a513 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:35.060476 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-48accfa0-57fc-4c62-8670-c3dc1248a513 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:35.060910 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-48accfa0-57fc-4c62-8670-c3dc1248a513 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:35.208743 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-48accfa0-57fc-4c62-8670-c3dc1248a513 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:35.216992 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-48accfa0-57fc-4c62-8670-c3dc1248a513 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1509 microversion: 2.1 time: 0.168404 Aug 03 13:02:35.217573 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 241/459] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:35 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:02:35.628615 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-f5f114d3-e154-4a5e-89fd-da972e33335e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:35.629749 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-f5f114d3-e154-4a5e-89fd-da972e33335e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:35.635899 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f5f114d3-e154-4a5e-89fd-da972e33335e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:35.636348 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f5f114d3-e154-4a5e-89fd-da972e33335e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:35.637279 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f5f114d3-e154-4a5e-89fd-da972e33335e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:35.637689 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f5f114d3-e154-4a5e-89fd-da972e33335e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:35.700501 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-f5f114d3-e154-4a5e-89fd-da972e33335e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:35.708620 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-f5f114d3-e154-4a5e-89fd-da972e33335e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1218 microversion: 2.1 time: 0.083974 Aug 03 13:02:35.709181 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 242/460] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:35 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:02:36.239410 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-6817f5cc-5e07-4db1-8a10-92b0ee652aba tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:36.240029 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-6817f5cc-5e07-4db1-8a10-92b0ee652aba tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:36.246571 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6817f5cc-5e07-4db1-8a10-92b0ee652aba tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:36.247061 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6817f5cc-5e07-4db1-8a10-92b0ee652aba tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:36.247838 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6817f5cc-5e07-4db1-8a10-92b0ee652aba tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:36.248264 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6817f5cc-5e07-4db1-8a10-92b0ee652aba tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:36.384107 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-6817f5cc-5e07-4db1-8a10-92b0ee652aba tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:36.391996 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-6817f5cc-5e07-4db1-8a10-92b0ee652aba tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1509 microversion: 2.1 time: 0.156631 Aug 03 13:02:36.392653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 243/461] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:36 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:02:36.733418 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d2ba2f9f-ed16-4926-a7a6-0f289d22a4a2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:36.735705 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-d2ba2f9f-ed16-4926-a7a6-0f289d22a4a2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:36.742630 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d2ba2f9f-ed16-4926-a7a6-0f289d22a4a2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:36.743117 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d2ba2f9f-ed16-4926-a7a6-0f289d22a4a2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:36.743919 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d2ba2f9f-ed16-4926-a7a6-0f289d22a4a2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:36.744380 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d2ba2f9f-ed16-4926-a7a6-0f289d22a4a2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:36.805406 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-d2ba2f9f-ed16-4926-a7a6-0f289d22a4a2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:36.817898 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-d2ba2f9f-ed16-4926-a7a6-0f289d22a4a2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1210 microversion: 2.1 time: 0.093391 Aug 03 13:02:36.818806 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 244/462] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:36 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:02:36.878909 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-e026124c-b8a9-4e35-80b2-0bd1cf6c8d97 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "POST /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.165367 Aug 03 13:02:36.881173 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 219/463] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Aug 3 13:02:34 2022] POST /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a/os-volume_attachments => generated 194 bytes in 2169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:02:37.414471 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-1c5e589f-68cf-4675-bc41-63a2a70ef81b tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:37.419387 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-1c5e589f-68cf-4675-bc41-63a2a70ef81b tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:37.427477 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1c5e589f-68cf-4675-bc41-63a2a70ef81b tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:37.427921 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1c5e589f-68cf-4675-bc41-63a2a70ef81b tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:37.428826 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1c5e589f-68cf-4675-bc41-63a2a70ef81b tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:37.429371 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1c5e589f-68cf-4675-bc41-63a2a70ef81b tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:37.580964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-1c5e589f-68cf-4675-bc41-63a2a70ef81b tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:37.588681 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-1c5e589f-68cf-4675-bc41-63a2a70ef81b tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1515 microversion: 2.1 time: 0.178610 Aug 03 13:02:37.594680 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 245/464] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:37 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1515 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:37.843839 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-a95cdf52-5128-49a7-b051-c136db350081 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:37.844525 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-a95cdf52-5128-49a7-b051-c136db350081 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:37.856808 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a95cdf52-5128-49a7-b051-c136db350081 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:37.857267 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a95cdf52-5128-49a7-b051-c136db350081 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:37.858048 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a95cdf52-5128-49a7-b051-c136db350081 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:37.858469 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a95cdf52-5128-49a7-b051-c136db350081 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:37.924771 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-a95cdf52-5128-49a7-b051-c136db350081 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:37.932947 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-a95cdf52-5128-49a7-b051-c136db350081 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1266 microversion: 2.1 time: 0.093250 Aug 03 13:02:37.933595 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 220/465] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:37 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:38.954621 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-4050924d-7ea1-4e16-8bcc-cf4ea8ff3fc5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:38.955281 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-4050924d-7ea1-4e16-8bcc-cf4ea8ff3fc5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:38.962130 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4050924d-7ea1-4e16-8bcc-cf4ea8ff3fc5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:38.962583 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4050924d-7ea1-4e16-8bcc-cf4ea8ff3fc5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:38.963777 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4050924d-7ea1-4e16-8bcc-cf4ea8ff3fc5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:38.964215 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4050924d-7ea1-4e16-8bcc-cf4ea8ff3fc5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:39.033079 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-4050924d-7ea1-4e16-8bcc-cf4ea8ff3fc5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:39.044585 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-4050924d-7ea1-4e16-8bcc-cf4ea8ff3fc5 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1272 microversion: 2.1 time: 0.091537 Aug 03 13:02:39.044585 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 246/466] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:38 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1272 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:40.061578 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-fb30c44b-cbf3-454c-8dae-c350ee032f2f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:40.062193 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-fb30c44b-cbf3-454c-8dae-c350ee032f2f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:40.068759 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fb30c44b-cbf3-454c-8dae-c350ee032f2f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:40.069211 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fb30c44b-cbf3-454c-8dae-c350ee032f2f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:40.069972 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fb30c44b-cbf3-454c-8dae-c350ee032f2f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:40.070413 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fb30c44b-cbf3-454c-8dae-c350ee032f2f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:40.205197 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-fb30c44b-cbf3-454c-8dae-c350ee032f2f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:40.217517 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-fb30c44b-cbf3-454c-8dae-c350ee032f2f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1314 microversion: 2.1 time: 0.159745 Aug 03 13:02:40.218131 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 221/467] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:40 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:41.239740 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-327aa5ff-a869-4c38-b305-5ffdd3b60b43 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:41.240351 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-327aa5ff-a869-4c38-b305-5ffdd3b60b43 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:41.246434 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-327aa5ff-a869-4c38-b305-5ffdd3b60b43 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:41.247722 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-327aa5ff-a869-4c38-b305-5ffdd3b60b43 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:41.247722 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-327aa5ff-a869-4c38-b305-5ffdd3b60b43 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:41.248105 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-327aa5ff-a869-4c38-b305-5ffdd3b60b43 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:41.391666 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-327aa5ff-a869-4c38-b305-5ffdd3b60b43 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:41.414381 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-327aa5ff-a869-4c38-b305-5ffdd3b60b43 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1314 microversion: 2.1 time: 0.164357 Aug 03 13:02:41.414381 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 247/468] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:41 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:42.421394 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-41f9fd34-ab99-421c-ab3c-7d22665c8aad tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:42.422115 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-41f9fd34-ab99-421c-ab3c-7d22665c8aad tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:42.424771 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:42.429660 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-41f9fd34-ab99-421c-ab3c-7d22665c8aad tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:42.430194 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-41f9fd34-ab99-421c-ab3c-7d22665c8aad tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:42.431053 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-41f9fd34-ab99-421c-ab3c-7d22665c8aad tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:42.431558 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-41f9fd34-ab99-421c-ab3c-7d22665c8aad tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:42.563913 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-41f9fd34-ab99-421c-ab3c-7d22665c8aad tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:42.572952 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-41f9fd34-ab99-421c-ab3c-7d22665c8aad tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1314 microversion: 2.1 time: 0.155516 Aug 03 13:02:42.577125 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 222/469] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:42 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:43.593847 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ba6e8d41-02ca-4ca9-88a8-5ae0844f4dd1 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:43.594472 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-ba6e8d41-02ca-4ca9-88a8-5ae0844f4dd1 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:43.601604 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ba6e8d41-02ca-4ca9-88a8-5ae0844f4dd1 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:43.602065 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ba6e8d41-02ca-4ca9-88a8-5ae0844f4dd1 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:43.602869 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ba6e8d41-02ca-4ca9-88a8-5ae0844f4dd1 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:43.603307 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ba6e8d41-02ca-4ca9-88a8-5ae0844f4dd1 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:43.738855 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ba6e8d41-02ca-4ca9-88a8-5ae0844f4dd1 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:43.746981 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-ba6e8d41-02ca-4ca9-88a8-5ae0844f4dd1 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1314 microversion: 2.1 time: 0.156839 Aug 03 13:02:43.747642 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 248/470] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:43 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:43.860491 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-813298f4-ed02-44a2-97d3-1864e8e9e214 req-5f4188bf-aa39-4bf7-9e06-3543ae67e805 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b87f710b-4cb8-4c2b-9377-c8bd9736329b", "tag": "edbb2ddb-54c9-45bc-bf81-11da22bf4d10"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:02:43.870128 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-813298f4-ed02-44a2-97d3-1864e8e9e214 req-5f4188bf-aa39-4bf7-9e06-3543ae67e805 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:43.870560 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-813298f4-ed02-44a2-97d3-1864e8e9e214 req-5f4188bf-aa39-4bf7-9e06-3543ae67e805 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:43.881865 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-813298f4-ed02-44a2-97d3-1864e8e9e214 req-5f4188bf-aa39-4bf7-9e06-3543ae67e805 service nova] Creating event network-changed:edbb2ddb-54c9-45bc-bf81-11da22bf4d10 for instance b87f710b-4cb8-4c2b-9377-c8bd9736329b on hv-cinder-85083 Aug 03 13:02:43.886633 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-813298f4-ed02-44a2-97d3-1864e8e9e214 req-5f4188bf-aa39-4bf7-9e06-3543ae67e805 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030038 Aug 03 13:02:43.887258 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 223/471] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:02:44.768155 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-816d47f0-febd-4269-b50d-0f0ed4a98d4e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:44.768704 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-816d47f0-febd-4269-b50d-0f0ed4a98d4e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:44.771262 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell0:SELECT=2 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:44.776110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-816d47f0-febd-4269-b50d-0f0ed4a98d4e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:44.776554 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-816d47f0-febd-4269-b50d-0f0ed4a98d4e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:44.781685 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-816d47f0-febd-4269-b50d-0f0ed4a98d4e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:44.781685 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-816d47f0-febd-4269-b50d-0f0ed4a98d4e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:44.914331 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-816d47f0-febd-4269-b50d-0f0ed4a98d4e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:44.921657 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-816d47f0-febd-4269-b50d-0f0ed4a98d4e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1314 microversion: 2.1 time: 0.157339 Aug 03 13:02:44.922206 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 249/472] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:44 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:45.938523 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=4 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:45.939329 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=6 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:45.943785 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-5cf3b469-8db0-4f95-9600-bd8e59838d12 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:45.944415 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-5cf3b469-8db0-4f95-9600-bd8e59838d12 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:45.950487 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5cf3b469-8db0-4f95-9600-bd8e59838d12 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:45.950980 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5cf3b469-8db0-4f95-9600-bd8e59838d12 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:45.951734 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5cf3b469-8db0-4f95-9600-bd8e59838d12 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:45.952165 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5cf3b469-8db0-4f95-9600-bd8e59838d12 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:46.082550 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-5cf3b469-8db0-4f95-9600-bd8e59838d12 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:46.090083 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-5cf3b469-8db0-4f95-9600-bd8e59838d12 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1314 microversion: 2.1 time: 0.152413 Aug 03 13:02:46.090661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 224/473] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:45 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:47.112688 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-80bb978c-1960-45de-b315-77a85e31db9e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:47.113747 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-80bb978c-1960-45de-b315-77a85e31db9e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:47.119708 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-80bb978c-1960-45de-b315-77a85e31db9e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:47.120158 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-80bb978c-1960-45de-b315-77a85e31db9e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:47.122374 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-80bb978c-1960-45de-b315-77a85e31db9e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:47.122892 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-80bb978c-1960-45de-b315-77a85e31db9e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:47.266679 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-80bb978c-1960-45de-b315-77a85e31db9e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:47.270160 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=100 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:47.274871 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-80bb978c-1960-45de-b315-77a85e31db9e tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1314 microversion: 2.1 time: 0.167216 Aug 03 13:02:47.275435 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 250/474] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:47 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:47.840852 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-8ddd3d9f-8ea9-4fe9-aca1-2f6247345a57 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Action: 'create', calling method: .version_select at 0x7fe6d8a19430>, body: {"keypair": {"name": "tempest-keypair-1041308654", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQcHYGxWblxoJDGZmGFZhhoTslaIAhtC/Ezq6o1RxFti2oyqYnffvlXMJmrsDbqayCFWvf4t9doGZXGSKEUE1soXUIVQ8eJQVL/z/ie4tJDpXpqJiBoSvw3J1sGIZ/1mQ=="}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:02:47.862110 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.quota [None req-8ddd3d9f-8ea9-4fe9-aca1-2f6247345a57 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Getting quotas for project 6be1056fe005471f83a0633c99c0b349. Resources: {'key_pairs'} {{(pid=119410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 13:02:47.866015 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.quota [None req-8ddd3d9f-8ea9-4fe9-aca1-2f6247345a57 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Getting quotas for user bb5f78a0ee0642c7bbde2ecf34e090d0 and project 6be1056fe005471f83a0633c99c0b349. Resources: {'key_pairs'} {{(pid=119410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 13:02:47.936805 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ccc17001-2fa2-4292-964d-10508bf82c1a tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:47.937420 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-ccc17001-2fa2-4292-964d-10508bf82c1a tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:47.944070 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ccc17001-2fa2-4292-964d-10508bf82c1a tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:47.944513 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ccc17001-2fa2-4292-964d-10508bf82c1a tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:47.945273 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ccc17001-2fa2-4292-964d-10508bf82c1a tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:47.945745 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ccc17001-2fa2-4292-964d-10508bf82c1a tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:47.987188 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-8ddd3d9f-8ea9-4fe9-aca1-2f6247345a57 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.149966 Aug 03 13:02:47.988489 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 225/475] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Aug 3 13:02:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:02:48.089131 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ccc17001-2fa2-4292-964d-10508bf82c1a tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:48.098018 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-ccc17001-2fa2-4292-964d-10508bf82c1a tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1595 microversion: 2.1 time: 0.164384 Aug 03 13:02:48.098595 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 251/476] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:47 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1595 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:02:48.300403 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-62611f79-5f7a-4ef1-a9dc-1fa9bb232419 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:48.301033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-62611f79-5f7a-4ef1-a9dc-1fa9bb232419 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:48.307542 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-62611f79-5f7a-4ef1-a9dc-1fa9bb232419 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:48.308432 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-62611f79-5f7a-4ef1-a9dc-1fa9bb232419 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:48.308767 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-62611f79-5f7a-4ef1-a9dc-1fa9bb232419 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:48.309204 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-62611f79-5f7a-4ef1-a9dc-1fa9bb232419 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:48.445571 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-62611f79-5f7a-4ef1-a9dc-1fa9bb232419 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:48.451739 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-62611f79-5f7a-4ef1-a9dc-1fa9bb232419 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1314 microversion: 2.1 time: 0.160697 Aug 03 13:02:48.452392 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 226/477] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:48 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:49.473636 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-9d8504d6-8964-433b-aa52-441e550fa9f7 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:49.474327 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-9d8504d6-8964-433b-aa52-441e550fa9f7 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:49.480302 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9d8504d6-8964-433b-aa52-441e550fa9f7 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:49.480748 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9d8504d6-8964-433b-aa52-441e550fa9f7 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:49.481507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9d8504d6-8964-433b-aa52-441e550fa9f7 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:49.481943 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9d8504d6-8964-433b-aa52-441e550fa9f7 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:49.694010 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-9d8504d6-8964-433b-aa52-441e550fa9f7 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:49.701741 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-9d8504d6-8964-433b-aa52-441e550fa9f7 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1314 microversion: 2.1 time: 0.232117 Aug 03 13:02:49.702681 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 252/478] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:49 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:50.722506 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-32ff0af4-022d-4188-8fe4-a4156c25f5a8 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:50.723320 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-32ff0af4-022d-4188-8fe4-a4156c25f5a8 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:50.731853 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-32ff0af4-022d-4188-8fe4-a4156c25f5a8 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:50.732574 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-32ff0af4-022d-4188-8fe4-a4156c25f5a8 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:50.733418 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-32ff0af4-022d-4188-8fe4-a4156c25f5a8 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:50.734122 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-32ff0af4-022d-4188-8fe4-a4156c25f5a8 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:50.823605 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-613caa99-fd93-4573-b81d-e79d4c7edcff tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1676823315", "imageRef": "c0aabcc0-d4af-4f0e-b8a5-d140344fce1f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ffaaaafc-a452-4bff-877a-5ebe89d49029"}], "security_groups": [{"name": "tempest-securitygroup--136569723"}], "key_name": "tempest-keypair-1041308654", "user_data": "}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:02:50.905609 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-32ff0af4-022d-4188-8fe4-a4156c25f5a8 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:50.913566 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-32ff0af4-022d-4188-8fe4-a4156c25f5a8 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1314 microversion: 2.1 time: 0.194918 Aug 03 13:02:50.914656 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 227/479] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:50 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:50.922467 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-9d88168c-6fd1-44ec-ae58-a822d14bc621 req-a908e7ee-5536-4d48-b3b7-75a305dec6a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49e06db0-38af-484d-8cc3-40999cc5fb8a", "tag": "2afbe9eb-dc9f-4e11-aca2-d72192f28195"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:02:50.941304 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-9d88168c-6fd1-44ec-ae58-a822d14bc621 req-a908e7ee-5536-4d48-b3b7-75a305dec6a1 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:50.941946 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-9d88168c-6fd1-44ec-ae58-a822d14bc621 req-a908e7ee-5536-4d48-b3b7-75a305dec6a1 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:50.955785 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-9d88168c-6fd1-44ec-ae58-a822d14bc621 req-a908e7ee-5536-4d48-b3b7-75a305dec6a1 service nova] Creating event network-changed:2afbe9eb-dc9f-4e11-aca2-d72192f28195 for instance 49e06db0-38af-484d-8cc3-40999cc5fb8a on hv-cinder-85083 Aug 03 13:02:50.961605 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-9d88168c-6fd1-44ec-ae58-a822d14bc621 req-a908e7ee-5536-4d48-b3b7-75a305dec6a1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045538 Aug 03 13:02:50.978305 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 228/480] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:02:51.029305 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.network.neutron [None req-613caa99-fd93-4573-b81d-e79d4c7edcff tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] validate_networks() for [('ffaaaafc-a452-4bff-877a-5ebe89d49029', None, None, None, None, None)] {{(pid=119409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 13:02:51.462465 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-613caa99-fd93-4573-b81d-e79d4c7edcff tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Flavor limits 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 13:02:51.462920 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-613caa99-fd93-4573-b81d-e79d4c7edcff tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Image limits 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 13:02:51.463398 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-613caa99-fd93-4573-b81d-e79d4c7edcff tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Flavor pref 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 13:02:51.463808 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-613caa99-fd93-4573-b81d-e79d4c7edcff tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Image pref 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 13:02:51.464210 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-613caa99-fd93-4573-b81d-e79d4c7edcff tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 13:02:51.474530 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-613caa99-fd93-4573-b81d-e79d4c7edcff tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:51.475012 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-613caa99-fd93-4573-b81d-e79d4c7edcff tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:51.475806 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-613caa99-fd93-4573-b81d-e79d4c7edcff tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:51.476243 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-613caa99-fd93-4573-b81d-e79d4c7edcff tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:51.494751 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-613caa99-fd93-4573-b81d-e79d4c7edcff tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Getting quotas for project 6be1056fe005471f83a0633c99c0b349. Resources: {'instances', 'ram', 'cores'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 13:02:51.500218 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-613caa99-fd93-4573-b81d-e79d4c7edcff tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Getting quotas for user bb5f78a0ee0642c7bbde2ecf34e090d0 and project 6be1056fe005471f83a0633c99c0b349. Resources: {'instances', 'ram', 'cores'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 13:02:51.512124 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-613caa99-fd93-4573-b81d-e79d4c7edcff tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Going to run 1 instances... {{(pid=119409) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 13:02:51.514415 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-613caa99-fd93-4573-b81d-e79d4c7edcff tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0aabcc0-d4af-4f0e-b8a5-d140344fce1f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 13:02:51.645957 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR oslo.messaging._drivers.impl_rabbit [None req-613caa99-fd93-4573-b81d-e79d4c7edcff tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [b729799c-2320-4947-bc4d-b3616f21014f] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 13:02:51.939145 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-902e095f-070b-441a-b865-5f939aaeede1 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:51.939834 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-902e095f-070b-441a-b865-5f939aaeede1 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:51.948255 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-902e095f-070b-441a-b865-5f939aaeede1 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:51.948255 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-902e095f-070b-441a-b865-5f939aaeede1 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:51.955797 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-902e095f-070b-441a-b865-5f939aaeede1 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:51.955797 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-902e095f-070b-441a-b865-5f939aaeede1 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:52.107751 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-902e095f-070b-441a-b865-5f939aaeede1 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:52.115412 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-902e095f-070b-441a-b865-5f939aaeede1 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1314 microversion: 2.1 time: 0.180555 Aug 03 13:02:52.115986 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 229/481] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:51 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:02:52.653000 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO oslo.messaging._drivers.impl_rabbit [None req-613caa99-fd93-4573-b81d-e79d4c7edcff tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [b729799c-2320-4947-bc4d-b3616f21014f] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 35886. Aug 03 13:02:52.657705 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-613caa99-fd93-4573-b81d-e79d4c7edcff tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.839996 Aug 03 13:02:52.658351 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 253/482] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 3 13:02:50 2022] POST /compute/v2.1/servers => generated 408 bytes in 1841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 13:02:52.669764 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-c9fdc045-b857-45ed-9570-249dbee5294d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:52.670374 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-c9fdc045-b857-45ed-9570-249dbee5294d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:52.743951 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c9fdc045-b857-45ed-9570-249dbee5294d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:52.753615 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-c9fdc045-b857-45ed-9570-249dbee5294d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1246 microversion: 2.1 time: 0.086405 Aug 03 13:02:52.753615 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 230/483] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:52 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:53.141629 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-007a9a7f-a097-4bee-8b41-d5ec4d5a11fb tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:53.142326 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-007a9a7f-a097-4bee-8b41-d5ec4d5a11fb tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:53.149982 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-007a9a7f-a097-4bee-8b41-d5ec4d5a11fb tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:53.150501 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-007a9a7f-a097-4bee-8b41-d5ec4d5a11fb tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:53.151449 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-007a9a7f-a097-4bee-8b41-d5ec4d5a11fb tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:53.151925 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-007a9a7f-a097-4bee-8b41-d5ec4d5a11fb tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:53.311472 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-007a9a7f-a097-4bee-8b41-d5ec4d5a11fb tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:53.321347 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-007a9a7f-a097-4bee-8b41-d5ec4d5a11fb tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1314 microversion: 2.1 time: 0.183699 Aug 03 13:02:53.322522 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 254/484] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:53 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:02:53.622981 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-cd09937e-7c57-4982-ab57-e87fc5165891 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1828376528"}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:02:53.623535 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-cd09937e-7c57-4982-ab57-e87fc5165891 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:53.630508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cd09937e-7c57-4982-ab57-e87fc5165891 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:53.630992 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cd09937e-7c57-4982-ab57-e87fc5165891 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:53.631747 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cd09937e-7c57-4982-ab57-e87fc5165891 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:53.632172 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cd09937e-7c57-4982-ab57-e87fc5165891 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:53.762178 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.network.security_group_api [None req-cd09937e-7c57-4982-ab57-e87fc5165891 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Adding security group a6ea19d2-cacc-4ce1-9f78-d68328be7c4b to port 2afbe9eb-dc9f-4e11-aca2-d72192f28195 Aug 03 13:02:53.773437 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-16f99f95-1359-4975-89da-1288ad458220 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:53.774080 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-16f99f95-1359-4975-89da-1288ad458220 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:53.780509 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-16f99f95-1359-4975-89da-1288ad458220 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:53.780952 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-16f99f95-1359-4975-89da-1288ad458220 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:53.781717 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-16f99f95-1359-4975-89da-1288ad458220 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:53.782500 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-16f99f95-1359-4975-89da-1288ad458220 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:53.867739 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-16f99f95-1359-4975-89da-1288ad458220 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:53.877538 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-16f99f95-1359-4975-89da-1288ad458220 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1250 microversion: 2.1 time: 0.108225 Aug 03 13:02:53.877978 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 255/485] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:53 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1250 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:02:54.257087 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-cd09937e-7c57-4982-ab57-e87fc5165891 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "POST /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a/action" status: 202 len: 0 microversion: 2.1 time: 0.637940 Aug 03 13:02:54.258378 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 231/486] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Aug 3 13:02:53 2022] POST /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a/action => generated 0 bytes in 640 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 13:02:54.266713 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-b4f96721-c7f0-40bd-b83a-fbe2742e66a1 req-9e96210a-ccf5-4c43-8d9b-f5719d73a9dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49e06db0-38af-484d-8cc3-40999cc5fb8a", "tag": "2afbe9eb-dc9f-4e11-aca2-d72192f28195"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:02:54.268146 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-831addcf-7085-40b4-b93f-561c0d905817 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:54.270064 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-831addcf-7085-40b4-b93f-561c0d905817 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:54.279757 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-831addcf-7085-40b4-b93f-561c0d905817 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:54.280354 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-831addcf-7085-40b4-b93f-561c0d905817 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:54.282080 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-831addcf-7085-40b4-b93f-561c0d905817 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:54.282578 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-831addcf-7085-40b4-b93f-561c0d905817 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:54.285770 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-b4f96721-c7f0-40bd-b83a-fbe2742e66a1 req-9e96210a-ccf5-4c43-8d9b-f5719d73a9dd service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:54.286245 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-b4f96721-c7f0-40bd-b83a-fbe2742e66a1 req-9e96210a-ccf5-4c43-8d9b-f5719d73a9dd service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:54.310956 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-b4f96721-c7f0-40bd-b83a-fbe2742e66a1 req-9e96210a-ccf5-4c43-8d9b-f5719d73a9dd service nova] Creating event network-changed:2afbe9eb-dc9f-4e11-aca2-d72192f28195 for instance 49e06db0-38af-484d-8cc3-40999cc5fb8a on hv-cinder-85083 Aug 03 13:02:54.322887 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-b4f96721-c7f0-40bd-b83a-fbe2742e66a1 req-9e96210a-ccf5-4c43-8d9b-f5719d73a9dd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059975 Aug 03 13:02:54.335432 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 256/487] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:02:54.347425 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-b8033150-c674-4646-9fce-8a31f0bca507 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:54.348496 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-b8033150-c674-4646-9fce-8a31f0bca507 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:54.355283 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b8033150-c674-4646-9fce-8a31f0bca507 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:54.355941 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b8033150-c674-4646-9fce-8a31f0bca507 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:54.356792 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b8033150-c674-4646-9fce-8a31f0bca507 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:54.357257 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b8033150-c674-4646-9fce-8a31f0bca507 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:54.495189 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-831addcf-7085-40b4-b93f-561c0d905817 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:54.504810 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-831addcf-7085-40b4-b93f-561c0d905817 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1761 microversion: 2.1 time: 0.241862 Aug 03 13:02:54.505609 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 232/488] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:54 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1761 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:02:54.536903 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b8033150-c674-4646-9fce-8a31f0bca507 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:54.544380 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-b8033150-c674-4646-9fce-8a31f0bca507 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1314 microversion: 2.1 time: 0.203655 Aug 03 13:02:54.544954 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 257/489] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:54 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:02:54.899694 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e28c291f-a973-47f5-8ae8-9cc0f0c447dc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:54.900218 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-e28c291f-a973-47f5-8ae8-9cc0f0c447dc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:54.907003 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e28c291f-a973-47f5-8ae8-9cc0f0c447dc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:54.907456 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e28c291f-a973-47f5-8ae8-9cc0f0c447dc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:54.908247 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e28c291f-a973-47f5-8ae8-9cc0f0c447dc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:54.908663 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e28c291f-a973-47f5-8ae8-9cc0f0c447dc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:54.969723 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-e28c291f-a973-47f5-8ae8-9cc0f0c447dc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:54.977063 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-e28c291f-a973-47f5-8ae8-9cc0f0c447dc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1298 microversion: 2.1 time: 0.083082 Aug 03 13:02:54.977633 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 233/490] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:54 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1298 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:55.565215 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-a5c247b3-e874-439f-9bdb-7432e9bd243f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:55.565856 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-a5c247b3-e874-439f-9bdb-7432e9bd243f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:55.572560 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a5c247b3-e874-439f-9bdb-7432e9bd243f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:55.573009 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a5c247b3-e874-439f-9bdb-7432e9bd243f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:55.573780 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a5c247b3-e874-439f-9bdb-7432e9bd243f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:55.574216 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a5c247b3-e874-439f-9bdb-7432e9bd243f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:55.710073 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-a5c247b3-e874-439f-9bdb-7432e9bd243f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:55.717902 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-a5c247b3-e874-439f-9bdb-7432e9bd243f tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1314 microversion: 2.1 time: 0.156680 Aug 03 13:02:55.719224 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 258/491] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:55 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:55.997929 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-657842cc-ef62-41d9-8d28-c959f31b28bd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:55.998644 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-657842cc-ef62-41d9-8d28-c959f31b28bd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:56.014326 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-657842cc-ef62-41d9-8d28-c959f31b28bd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:56.016532 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-657842cc-ef62-41d9-8d28-c959f31b28bd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:56.016810 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-657842cc-ef62-41d9-8d28-c959f31b28bd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:56.017540 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-657842cc-ef62-41d9-8d28-c959f31b28bd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:56.117697 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-657842cc-ef62-41d9-8d28-c959f31b28bd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:56.130446 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-657842cc-ef62-41d9-8d28-c959f31b28bd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1316 microversion: 2.1 time: 0.136971 Aug 03 13:02:56.131408 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 234/492] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:55 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1316 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:56.351227 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-fe91b68b-980c-4c24-8301-c33fa1838d74 req-1467ad7d-cb49-4209-815d-7958272435fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b87f710b-4cb8-4c2b-9377-c8bd9736329b", "name": "network-vif-plugged", "status": "completed", "tag": "edbb2ddb-54c9-45bc-bf81-11da22bf4d10"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:02:56.363599 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-fe91b68b-980c-4c24-8301-c33fa1838d74 req-1467ad7d-cb49-4209-815d-7958272435fe service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:56.364328 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-fe91b68b-980c-4c24-8301-c33fa1838d74 req-1467ad7d-cb49-4209-815d-7958272435fe service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:56.375966 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-fe91b68b-980c-4c24-8301-c33fa1838d74 req-1467ad7d-cb49-4209-815d-7958272435fe service nova] Creating event network-vif-plugged:edbb2ddb-54c9-45bc-bf81-11da22bf4d10 for instance b87f710b-4cb8-4c2b-9377-c8bd9736329b on hv-cinder-85083 Aug 03 13:02:56.381732 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-fe91b68b-980c-4c24-8301-c33fa1838d74 req-1467ad7d-cb49-4209-815d-7958272435fe service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034178 Aug 03 13:02:56.382595 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 259/493] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:02:56.741229 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-bf5a9c05-48b9-4d5f-aea1-266d2f1307ec tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:56.742029 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-bf5a9c05-48b9-4d5f-aea1-266d2f1307ec tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:56.752214 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bf5a9c05-48b9-4d5f-aea1-266d2f1307ec tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:56.756396 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bf5a9c05-48b9-4d5f-aea1-266d2f1307ec tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:56.764551 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bf5a9c05-48b9-4d5f-aea1-266d2f1307ec tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:56.764551 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bf5a9c05-48b9-4d5f-aea1-266d2f1307ec tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:56.924219 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-bf5a9c05-48b9-4d5f-aea1-266d2f1307ec tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:56.938593 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-bf5a9c05-48b9-4d5f-aea1-266d2f1307ec tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1314 microversion: 2.1 time: 0.202987 Aug 03 13:02:56.939653 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 235/494] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:56 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:57.157965 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-8b31d1ea-8185-47a0-accb-34f481e57236 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:57.159990 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-8b31d1ea-8185-47a0-accb-34f481e57236 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:57.167928 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8b31d1ea-8185-47a0-accb-34f481e57236 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:57.168684 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8b31d1ea-8185-47a0-accb-34f481e57236 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:57.169486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8b31d1ea-8185-47a0-accb-34f481e57236 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:57.169924 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8b31d1ea-8185-47a0-accb-34f481e57236 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:57.325346 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-8b31d1ea-8185-47a0-accb-34f481e57236 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:57.331407 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-8b31d1ea-8185-47a0-accb-34f481e57236 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1371 microversion: 2.1 time: 0.183378 Aug 03 13:02:57.332536 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 260/495] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:57 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:57.804537 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-a25a58fb-8f42-4800-90c1-11cc751baf32 req-0a33a9bb-b4fb-4721-b744-522869015eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76bb2b00-bafa-4b66-98f4-882ae210fe14", "tag": "9b3298cc-4607-4438-a82a-2051f630b8a0"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:02:57.814417 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-a25a58fb-8f42-4800-90c1-11cc751baf32 req-0a33a9bb-b4fb-4721-b744-522869015eb2 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:57.814901 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-a25a58fb-8f42-4800-90c1-11cc751baf32 req-0a33a9bb-b4fb-4721-b744-522869015eb2 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:57.826325 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-a25a58fb-8f42-4800-90c1-11cc751baf32 req-0a33a9bb-b4fb-4721-b744-522869015eb2 service nova] Creating event network-changed:9b3298cc-4607-4438-a82a-2051f630b8a0 for instance 76bb2b00-bafa-4b66-98f4-882ae210fe14 on hv-cinder-85083 Aug 03 13:02:57.831125 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-a25a58fb-8f42-4800-90c1-11cc751baf32 req-0a33a9bb-b4fb-4721-b744-522869015eb2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030101 Aug 03 13:02:57.831779 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 236/496] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:02:57.963933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-3f958656-595f-49b1-b22a-2e678aac0af0 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:57.964575 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-3f958656-595f-49b1-b22a-2e678aac0af0 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:57.970563 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3f958656-595f-49b1-b22a-2e678aac0af0 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:57.971044 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3f958656-595f-49b1-b22a-2e678aac0af0 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:57.972318 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3f958656-595f-49b1-b22a-2e678aac0af0 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:57.972754 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3f958656-595f-49b1-b22a-2e678aac0af0 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:58.108622 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-3f958656-595f-49b1-b22a-2e678aac0af0 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:58.116932 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-3f958656-595f-49b1-b22a-2e678aac0af0 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1314 microversion: 2.1 time: 0.156945 Aug 03 13:02:58.117547 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 261/497] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:57 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:58.353625 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-38bedd35-be9d-4e19-a463-f9ffeea65156 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:58.354557 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-38bedd35-be9d-4e19-a463-f9ffeea65156 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:58.360894 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-38bedd35-be9d-4e19-a463-f9ffeea65156 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:58.361288 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-38bedd35-be9d-4e19-a463-f9ffeea65156 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:58.362058 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-38bedd35-be9d-4e19-a463-f9ffeea65156 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:58.362664 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-38bedd35-be9d-4e19-a463-f9ffeea65156 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:58.506817 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-38bedd35-be9d-4e19-a463-f9ffeea65156 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:58.509135 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:58.514845 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-38bedd35-be9d-4e19-a463-f9ffeea65156 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1371 microversion: 2.1 time: 0.165693 Aug 03 13:02:58.515414 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 237/498] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:58 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:59.137757 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-fd86da80-c998-46cc-ac63-0773ba5866aa tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:59.138349 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-fd86da80-c998-46cc-ac63-0773ba5866aa tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:59.144853 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fd86da80-c998-46cc-ac63-0773ba5866aa tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:59.145291 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fd86da80-c998-46cc-ac63-0773ba5866aa tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:59.146042 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fd86da80-c998-46cc-ac63-0773ba5866aa tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:59.146473 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fd86da80-c998-46cc-ac63-0773ba5866aa tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:59.277730 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-fd86da80-c998-46cc-ac63-0773ba5866aa tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:59.286025 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-fd86da80-c998-46cc-ac63-0773ba5866aa tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1314 microversion: 2.1 time: 0.152088 Aug 03 13:02:59.286586 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 262/499] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:59 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:02:59.536242 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-fb6a0195-a513-4312-8744-32ce0d9b9ca4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:02:59.536759 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-fb6a0195-a513-4312-8744-32ce0d9b9ca4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:02:59.544095 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fb6a0195-a513-4312-8744-32ce0d9b9ca4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:59.544555 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fb6a0195-a513-4312-8744-32ce0d9b9ca4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:59.545320 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fb6a0195-a513-4312-8744-32ce0d9b9ca4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:02:59.545763 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fb6a0195-a513-4312-8744-32ce0d9b9ca4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:02:59.897458 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-fb6a0195-a513-4312-8744-32ce0d9b9ca4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:02:59.905002 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-fb6a0195-a513-4312-8744-32ce0d9b9ca4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1371 microversion: 2.1 time: 0.372638 Aug 03 13:02:59.905582 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 238/500] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:02:59 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1371 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:03:00.306865 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-c76e52b3-acbd-43fb-85dc-03e6bc15b266 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:00.307640 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-c76e52b3-acbd-43fb-85dc-03e6bc15b266 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:00.309803 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:00.316511 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c76e52b3-acbd-43fb-85dc-03e6bc15b266 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:00.316945 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c76e52b3-acbd-43fb-85dc-03e6bc15b266 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:00.317912 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c76e52b3-acbd-43fb-85dc-03e6bc15b266 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:00.318339 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c76e52b3-acbd-43fb-85dc-03e6bc15b266 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:00.462606 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-c76e52b3-acbd-43fb-85dc-03e6bc15b266 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:00.470070 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-c76e52b3-acbd-43fb-85dc-03e6bc15b266 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1498 microversion: 2.1 time: 0.167396 Aug 03 13:03:00.470628 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 263/501] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:00 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1498 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:03:00.926158 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-3aca0ea2-0da3-463e-a9c7-722dec387681 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:00.926870 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-3aca0ea2-0da3-463e-a9c7-722dec387681 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:00.933396 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3aca0ea2-0da3-463e-a9c7-722dec387681 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:00.933912 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3aca0ea2-0da3-463e-a9c7-722dec387681 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:00.934688 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3aca0ea2-0da3-463e-a9c7-722dec387681 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:00.935158 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3aca0ea2-0da3-463e-a9c7-722dec387681 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:01.070459 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-3aca0ea2-0da3-463e-a9c7-722dec387681 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:01.076609 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-3aca0ea2-0da3-463e-a9c7-722dec387681 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1371 microversion: 2.1 time: 0.154880 Aug 03 13:03:01.077199 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 239/502] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:00 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:03:02.099060 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-2472b1cc-913a-4746-ba44-7177be8c9ccb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:02.099674 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-2472b1cc-913a-4746-ba44-7177be8c9ccb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:02.101533 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell0:SELECT=2 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:02.102182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell0:SELECT=6 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:02.106929 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2472b1cc-913a-4746-ba44-7177be8c9ccb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:02.107407 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2472b1cc-913a-4746-ba44-7177be8c9ccb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:02.108165 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2472b1cc-913a-4746-ba44-7177be8c9ccb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:02.108594 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2472b1cc-913a-4746-ba44-7177be8c9ccb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:02.243470 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-2472b1cc-913a-4746-ba44-7177be8c9ccb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:02.251354 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-2472b1cc-913a-4746-ba44-7177be8c9ccb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1371 microversion: 2.1 time: 0.156830 Aug 03 13:03:02.252006 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 264/503] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:02 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:03:02.286228 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-f345e822-01b0-49fe-af9d-db3583e89b9d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:02.286723 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-f345e822-01b0-49fe-af9d-db3583e89b9d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:02.293261 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f345e822-01b0-49fe-af9d-db3583e89b9d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:02.293707 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f345e822-01b0-49fe-af9d-db3583e89b9d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:02.294457 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f345e822-01b0-49fe-af9d-db3583e89b9d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:02.294909 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f345e822-01b0-49fe-af9d-db3583e89b9d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:02.324076 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-f345e822-01b0-49fe-af9d-db3583e89b9d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Going to try to terminate instance {{(pid=119410) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 13:03:02.621406 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-f345e822-01b0-49fe-af9d-db3583e89b9d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "DELETE /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 204 len: 0 microversion: 2.1 time: 0.339334 Aug 03 13:03:02.622180 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 240/504] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 3 13:03:02 2022] DELETE /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 13:03:02.639294 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-b00d1985-16f4-478a-a613-a123b2557775 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:02.639899 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-b00d1985-16f4-478a-a613-a123b2557775 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:02.647806 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b00d1985-16f4-478a-a613-a123b2557775 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:02.648249 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b00d1985-16f4-478a-a613-a123b2557775 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:02.649000 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b00d1985-16f4-478a-a613-a123b2557775 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:02.649430 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b00d1985-16f4-478a-a613-a123b2557775 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:02.787727 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b00d1985-16f4-478a-a613-a123b2557775 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:02.798880 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-b00d1985-16f4-478a-a613-a123b2557775 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1504 microversion: 2.1 time: 0.163664 Aug 03 13:03:02.799991 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 265/505] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:02 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:03:03.272216 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-0c5b7745-762d-4daf-80a4-2331b38caf25 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:03.273038 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-0c5b7745-762d-4daf-80a4-2331b38caf25 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:03.275161 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=6 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:03.280316 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0c5b7745-762d-4daf-80a4-2331b38caf25 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:03.280770 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0c5b7745-762d-4daf-80a4-2331b38caf25 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:03.281789 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0c5b7745-762d-4daf-80a4-2331b38caf25 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:03.282224 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0c5b7745-762d-4daf-80a4-2331b38caf25 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:03.421436 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-0c5b7745-762d-4daf-80a4-2331b38caf25 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:03.429562 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-0c5b7745-762d-4daf-80a4-2331b38caf25 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1371 microversion: 2.1 time: 0.161541 Aug 03 13:03:03.430125 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 241/506] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:03 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:03:03.820739 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-bc28d858-e891-427b-ab4e-092af27b935a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:03.823517 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-bc28d858-e891-427b-ab4e-092af27b935a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:03.827739 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bc28d858-e891-427b-ab4e-092af27b935a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:03.828174 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bc28d858-e891-427b-ab4e-092af27b935a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:03.828928 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bc28d858-e891-427b-ab4e-092af27b935a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:03.829395 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bc28d858-e891-427b-ab4e-092af27b935a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:03.970628 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-bc28d858-e891-427b-ab4e-092af27b935a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:03.978714 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-bc28d858-e891-427b-ab4e-092af27b935a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1504 microversion: 2.1 time: 0.161990 Aug 03 13:03:03.984563 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 266/507] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:03 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:03:04.449592 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-b7fc62cb-d830-49e3-99fc-30565d5cde10 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:04.450768 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-b7fc62cb-d830-49e3-99fc-30565d5cde10 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:04.458298 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b7fc62cb-d830-49e3-99fc-30565d5cde10 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:04.459221 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b7fc62cb-d830-49e3-99fc-30565d5cde10 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:04.460183 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b7fc62cb-d830-49e3-99fc-30565d5cde10 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:04.460780 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b7fc62cb-d830-49e3-99fc-30565d5cde10 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:04.594210 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-b7fc62cb-d830-49e3-99fc-30565d5cde10 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:04.601715 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-b7fc62cb-d830-49e3-99fc-30565d5cde10 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1371 microversion: 2.1 time: 0.155925 Aug 03 13:03:04.602277 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 242/508] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:04 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:03:04.999699 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-988552d6-26cc-482c-b077-a406edacc236 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:05.000419 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-988552d6-26cc-482c-b077-a406edacc236 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:05.006431 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-988552d6-26cc-482c-b077-a406edacc236 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:05.013005 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-988552d6-26cc-482c-b077-a406edacc236 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:05.013005 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-988552d6-26cc-482c-b077-a406edacc236 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:05.013005 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-988552d6-26cc-482c-b077-a406edacc236 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:05.156249 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-988552d6-26cc-482c-b077-a406edacc236 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:05.164617 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-988552d6-26cc-482c-b077-a406edacc236 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1504 microversion: 2.1 time: 0.168678 Aug 03 13:03:05.165206 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 267/509] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:04 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:03:05.622690 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-7515584c-e75b-4d03-8b2d-a3ecd6f71cd8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:05.623427 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-7515584c-e75b-4d03-8b2d-a3ecd6f71cd8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:05.630482 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7515584c-e75b-4d03-8b2d-a3ecd6f71cd8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:05.631041 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7515584c-e75b-4d03-8b2d-a3ecd6f71cd8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:05.631814 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7515584c-e75b-4d03-8b2d-a3ecd6f71cd8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:05.632255 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7515584c-e75b-4d03-8b2d-a3ecd6f71cd8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:05.766066 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-7515584c-e75b-4d03-8b2d-a3ecd6f71cd8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:05.773820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-7515584c-e75b-4d03-8b2d-a3ecd6f71cd8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1371 microversion: 2.1 time: 0.154968 Aug 03 13:03:05.774381 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 243/510] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:05 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:03:06.186357 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-09270839-29ce-4394-acfc-78d074ca1146 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:06.187169 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-09270839-29ce-4394-acfc-78d074ca1146 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:06.194697 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-09270839-29ce-4394-acfc-78d074ca1146 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:06.195181 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-09270839-29ce-4394-acfc-78d074ca1146 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:06.195949 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-09270839-29ce-4394-acfc-78d074ca1146 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:06.196579 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-09270839-29ce-4394-acfc-78d074ca1146 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:06.285603 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-f153f520-7d7a-4955-8dce-2761b38ced01 req-038c8cd2-1f02-45d2-8a7b-10c94e54f1ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76bb2b00-bafa-4b66-98f4-882ae210fe14", "name": "network-vif-plugged", "status": "completed", "tag": "9b3298cc-4607-4438-a82a-2051f630b8a0"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:03:06.301693 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-f153f520-7d7a-4955-8dce-2761b38ced01 req-038c8cd2-1f02-45d2-8a7b-10c94e54f1ec service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:06.302129 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-f153f520-7d7a-4955-8dce-2761b38ced01 req-038c8cd2-1f02-45d2-8a7b-10c94e54f1ec service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:06.313996 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-f153f520-7d7a-4955-8dce-2761b38ced01 req-038c8cd2-1f02-45d2-8a7b-10c94e54f1ec service nova] Creating event network-vif-plugged:9b3298cc-4607-4438-a82a-2051f630b8a0 for instance 76bb2b00-bafa-4b66-98f4-882ae210fe14 on hv-cinder-85083 Aug 03 13:03:06.319505 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-f153f520-7d7a-4955-8dce-2761b38ced01 req-038c8cd2-1f02-45d2-8a7b-10c94e54f1ec service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038069 Aug 03 13:03:06.320452 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 244/511] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:03:06.355715 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-09270839-29ce-4394-acfc-78d074ca1146 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:06.363886 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-09270839-29ce-4394-acfc-78d074ca1146 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1504 microversion: 2.1 time: 0.181723 Aug 03 13:03:06.364451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 268/512] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:06 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1504 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:03:06.504734 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-48f26a8e-e905-4220-8356-726b7f11e008 req-725b012e-40d3-4138-8f43-db83f93ce5b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b87f710b-4cb8-4c2b-9377-c8bd9736329b", "name": "network-vif-deleted", "tag": "edbb2ddb-54c9-45bc-bf81-11da22bf4d10"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:03:06.514245 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-48f26a8e-e905-4220-8356-726b7f11e008 req-725b012e-40d3-4138-8f43-db83f93ce5b5 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:06.514689 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-48f26a8e-e905-4220-8356-726b7f11e008 req-725b012e-40d3-4138-8f43-db83f93ce5b5 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:06.525892 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-48f26a8e-e905-4220-8356-726b7f11e008 req-725b012e-40d3-4138-8f43-db83f93ce5b5 service nova] Creating event network-vif-deleted:edbb2ddb-54c9-45bc-bf81-11da22bf4d10 for instance b87f710b-4cb8-4c2b-9377-c8bd9736329b on hv-cinder-85083 Aug 03 13:03:06.531134 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-48f26a8e-e905-4220-8356-726b7f11e008 req-725b012e-40d3-4138-8f43-db83f93ce5b5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030431 Aug 03 13:03:06.531908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 245/513] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:03:06.795031 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-47c9033b-b6c9-40be-8717-8ab380dc26ad tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:06.795691 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-47c9033b-b6c9-40be-8717-8ab380dc26ad tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:06.801793 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-47c9033b-b6c9-40be-8717-8ab380dc26ad tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:06.802313 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-47c9033b-b6c9-40be-8717-8ab380dc26ad tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:06.803138 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-47c9033b-b6c9-40be-8717-8ab380dc26ad tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:06.803572 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-47c9033b-b6c9-40be-8717-8ab380dc26ad tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:06.821365 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=100 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:06.939050 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-47c9033b-b6c9-40be-8717-8ab380dc26ad tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:06.946872 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-47c9033b-b6c9-40be-8717-8ab380dc26ad tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1371 microversion: 2.1 time: 0.155793 Aug 03 13:03:06.947433 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 269/514] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:06 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:03:07.386674 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-438b164b-a3cf-4f54-9bbd-27eb5627d03c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:07.387521 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-438b164b-a3cf-4f54-9bbd-27eb5627d03c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:07.393732 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-438b164b-a3cf-4f54-9bbd-27eb5627d03c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:07.394185 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-438b164b-a3cf-4f54-9bbd-27eb5627d03c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:07.402036 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-438b164b-a3cf-4f54-9bbd-27eb5627d03c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:07.402036 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-438b164b-a3cf-4f54-9bbd-27eb5627d03c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:07.425919 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-438b164b-a3cf-4f54-9bbd-27eb5627d03c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:07.426370 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-438b164b-a3cf-4f54-9bbd-27eb5627d03c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:07.427006 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-438b164b-a3cf-4f54-9bbd-27eb5627d03c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lazy-loading 'fault' on Instance uuid b87f710b-4cb8-4c2b-9377-c8bd9736329b {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:03:07.469660 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-438b164b-a3cf-4f54-9bbd-27eb5627d03c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:07.477919 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-438b164b-a3cf-4f54-9bbd-27eb5627d03c tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1304 microversion: 2.1 time: 0.095901 Aug 03 13:03:07.478494 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 246/515] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:07 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:03:07.967452 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-54e7ece8-0902-4671-a7f7-8dbcc8da0e35 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:07.968000 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-54e7ece8-0902-4671-a7f7-8dbcc8da0e35 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:07.974066 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-54e7ece8-0902-4671-a7f7-8dbcc8da0e35 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:07.974514 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-54e7ece8-0902-4671-a7f7-8dbcc8da0e35 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:07.975317 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-54e7ece8-0902-4671-a7f7-8dbcc8da0e35 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:07.975754 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-54e7ece8-0902-4671-a7f7-8dbcc8da0e35 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:08.104455 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-54e7ece8-0902-4671-a7f7-8dbcc8da0e35 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:08.111829 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-54e7ece8-0902-4671-a7f7-8dbcc8da0e35 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1371 microversion: 2.1 time: 0.148275 Aug 03 13:03:08.112386 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 270/516] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:07 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:03:08.501737 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-b6a15540-15f3-4d7a-ab7c-13bae454fae0 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:08.502339 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-b6a15540-15f3-4d7a-ab7c-13bae454fae0 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:08.508959 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b6a15540-15f3-4d7a-ab7c-13bae454fae0 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:08.509488 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b6a15540-15f3-4d7a-ab7c-13bae454fae0 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:08.514759 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b6a15540-15f3-4d7a-ab7c-13bae454fae0 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:08.514759 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b6a15540-15f3-4d7a-ab7c-13bae454fae0 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:08.542073 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b6a15540-15f3-4d7a-ab7c-13bae454fae0 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:08.542508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b6a15540-15f3-4d7a-ab7c-13bae454fae0 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:08.542976 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-b6a15540-15f3-4d7a-ab7c-13bae454fae0 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lazy-loading 'fault' on Instance uuid b87f710b-4cb8-4c2b-9377-c8bd9736329b {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:03:08.583178 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-b6a15540-15f3-4d7a-ab7c-13bae454fae0 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:08.590647 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-b6a15540-15f3-4d7a-ab7c-13bae454fae0 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1304 microversion: 2.1 time: 0.093131 Aug 03 13:03:08.591257 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 247/517] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:08 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:03:09.133144 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-8275e1e5-c9df-451e-8093-39fd21e04b09 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:09.133745 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-8275e1e5-c9df-451e-8093-39fd21e04b09 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:09.139722 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8275e1e5-c9df-451e-8093-39fd21e04b09 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:09.140159 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8275e1e5-c9df-451e-8093-39fd21e04b09 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:09.140910 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8275e1e5-c9df-451e-8093-39fd21e04b09 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:09.141336 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8275e1e5-c9df-451e-8093-39fd21e04b09 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:09.267171 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-8275e1e5-c9df-451e-8093-39fd21e04b09 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:09.277439 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-8275e1e5-c9df-451e-8093-39fd21e04b09 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1371 microversion: 2.1 time: 0.148574 Aug 03 13:03:09.278006 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 271/518] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:09 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:03:09.611950 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-4c8e9fbf-4243-4f63-ab0e-a582fb099eef tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:09.612477 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-4c8e9fbf-4243-4f63-ab0e-a582fb099eef tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:09.619490 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4c8e9fbf-4243-4f63-ab0e-a582fb099eef tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:09.619933 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4c8e9fbf-4243-4f63-ab0e-a582fb099eef tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:09.620679 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4c8e9fbf-4243-4f63-ab0e-a582fb099eef tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:09.621106 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4c8e9fbf-4243-4f63-ab0e-a582fb099eef tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:09.650850 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4c8e9fbf-4243-4f63-ab0e-a582fb099eef tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:09.651290 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4c8e9fbf-4243-4f63-ab0e-a582fb099eef tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:09.651723 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-4c8e9fbf-4243-4f63-ab0e-a582fb099eef tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lazy-loading 'fault' on Instance uuid b87f710b-4cb8-4c2b-9377-c8bd9736329b {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:03:09.695436 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-4c8e9fbf-4243-4f63-ab0e-a582fb099eef tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:09.702607 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-4c8e9fbf-4243-4f63-ab0e-a582fb099eef tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1304 microversion: 2.1 time: 0.094550 Aug 03 13:03:09.703196 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 248/519] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:09 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:03:10.297707 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-491ec283-dc5b-4c77-b70e-a716c07bd7a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:10.298250 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-491ec283-dc5b-4c77-b70e-a716c07bd7a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:10.304287 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-491ec283-dc5b-4c77-b70e-a716c07bd7a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:10.304743 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-491ec283-dc5b-4c77-b70e-a716c07bd7a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:10.305495 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-491ec283-dc5b-4c77-b70e-a716c07bd7a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:10.305929 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-491ec283-dc5b-4c77-b70e-a716c07bd7a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:10.431985 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-491ec283-dc5b-4c77-b70e-a716c07bd7a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:10.439557 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-491ec283-dc5b-4c77-b70e-a716c07bd7a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1371 microversion: 2.1 time: 0.145846 Aug 03 13:03:10.440109 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 272/520] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:10 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:03:10.723380 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-17ad23ac-3da4-410d-a09b-4fd88366e01b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:10.723987 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-17ad23ac-3da4-410d-a09b-4fd88366e01b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:10.730329 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-17ad23ac-3da4-410d-a09b-4fd88366e01b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:10.730792 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-17ad23ac-3da4-410d-a09b-4fd88366e01b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:10.731545 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-17ad23ac-3da4-410d-a09b-4fd88366e01b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:10.731969 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-17ad23ac-3da4-410d-a09b-4fd88366e01b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:10.761581 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-17ad23ac-3da4-410d-a09b-4fd88366e01b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:10.762017 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-17ad23ac-3da4-410d-a09b-4fd88366e01b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:10.762453 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-17ad23ac-3da4-410d-a09b-4fd88366e01b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lazy-loading 'fault' on Instance uuid b87f710b-4cb8-4c2b-9377-c8bd9736329b {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:03:10.803193 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-17ad23ac-3da4-410d-a09b-4fd88366e01b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:10.810575 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-17ad23ac-3da4-410d-a09b-4fd88366e01b tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1304 microversion: 2.1 time: 0.091101 Aug 03 13:03:10.811154 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 249/521] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:10 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:03:11.459923 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ae2e1fd4-82c4-4c16-9cd6-dc9ddb5661ae tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:11.460539 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-ae2e1fd4-82c4-4c16-9cd6-dc9ddb5661ae tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:11.466569 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ae2e1fd4-82c4-4c16-9cd6-dc9ddb5661ae tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:11.473699 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ae2e1fd4-82c4-4c16-9cd6-dc9ddb5661ae tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:11.473699 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ae2e1fd4-82c4-4c16-9cd6-dc9ddb5661ae tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:11.473699 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ae2e1fd4-82c4-4c16-9cd6-dc9ddb5661ae tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:11.600364 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ae2e1fd4-82c4-4c16-9cd6-dc9ddb5661ae tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:11.607754 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-ae2e1fd4-82c4-4c16-9cd6-dc9ddb5661ae tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1371 microversion: 2.1 time: 0.151715 Aug 03 13:03:11.608312 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 273/522] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:11 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:03:11.831224 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-f90c6602-384e-4277-9fb7-a05521e44c4d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:11.831842 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-f90c6602-384e-4277-9fb7-a05521e44c4d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:11.838444 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f90c6602-384e-4277-9fb7-a05521e44c4d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:11.838930 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f90c6602-384e-4277-9fb7-a05521e44c4d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:11.839699 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f90c6602-384e-4277-9fb7-a05521e44c4d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:11.840132 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f90c6602-384e-4277-9fb7-a05521e44c4d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:11.876610 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f90c6602-384e-4277-9fb7-a05521e44c4d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:11.877062 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f90c6602-384e-4277-9fb7-a05521e44c4d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:11.877508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-f90c6602-384e-4277-9fb7-a05521e44c4d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lazy-loading 'fault' on Instance uuid b87f710b-4cb8-4c2b-9377-c8bd9736329b {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:03:11.918594 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-f90c6602-384e-4277-9fb7-a05521e44c4d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:11.925920 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-f90c6602-384e-4277-9fb7-a05521e44c4d tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1304 microversion: 2.1 time: 0.098459 Aug 03 13:03:11.926532 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 250/523] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:11 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:03:12.628433 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-95749274-3d48-4585-a3d4-546b34df85ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:12.628980 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-95749274-3d48-4585-a3d4-546b34df85ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:12.635681 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-95749274-3d48-4585-a3d4-546b34df85ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:12.636119 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-95749274-3d48-4585-a3d4-546b34df85ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:12.636864 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-95749274-3d48-4585-a3d4-546b34df85ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:12.637286 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-95749274-3d48-4585-a3d4-546b34df85ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:12.762706 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-95749274-3d48-4585-a3d4-546b34df85ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:12.770555 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-95749274-3d48-4585-a3d4-546b34df85ec tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1371 microversion: 2.1 time: 0.145530 Aug 03 13:03:12.771145 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 274/524] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:12 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:03:12.947007 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-6b5c4cc1-541e-40c3-9ddf-55fef001d98a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:12.947607 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-6b5c4cc1-541e-40c3-9ddf-55fef001d98a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:12.954070 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6b5c4cc1-541e-40c3-9ddf-55fef001d98a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:12.954515 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6b5c4cc1-541e-40c3-9ddf-55fef001d98a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:12.955282 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6b5c4cc1-541e-40c3-9ddf-55fef001d98a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:12.955706 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6b5c4cc1-541e-40c3-9ddf-55fef001d98a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:12.984956 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6b5c4cc1-541e-40c3-9ddf-55fef001d98a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:12.985402 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6b5c4cc1-541e-40c3-9ddf-55fef001d98a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:12.985836 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-6b5c4cc1-541e-40c3-9ddf-55fef001d98a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lazy-loading 'fault' on Instance uuid b87f710b-4cb8-4c2b-9377-c8bd9736329b {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:03:13.029937 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-6b5c4cc1-541e-40c3-9ddf-55fef001d98a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:13.037289 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-6b5c4cc1-541e-40c3-9ddf-55fef001d98a tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1304 microversion: 2.1 time: 0.094090 Aug 03 13:03:13.037854 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 251/525] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:12 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:03:13.791520 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d3d687c2-9956-46f5-a70e-f6a729739d90 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:13.792154 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-d3d687c2-9956-46f5-a70e-f6a729739d90 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:13.798088 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d3d687c2-9956-46f5-a70e-f6a729739d90 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:13.798535 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d3d687c2-9956-46f5-a70e-f6a729739d90 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:13.799341 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d3d687c2-9956-46f5-a70e-f6a729739d90 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:13.799762 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d3d687c2-9956-46f5-a70e-f6a729739d90 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:13.939138 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-d3d687c2-9956-46f5-a70e-f6a729739d90 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:13.946877 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-d3d687c2-9956-46f5-a70e-f6a729739d90 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1371 microversion: 2.1 time: 0.159219 Aug 03 13:03:13.947430 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 275/526] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:13 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:03:14.058571 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-8dd87275-8e93-4506-acc1-22c7f3c11324 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:14.059124 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-8dd87275-8e93-4506-acc1-22c7f3c11324 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:14.061582 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:14.066351 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8dd87275-8e93-4506-acc1-22c7f3c11324 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:14.067476 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8dd87275-8e93-4506-acc1-22c7f3c11324 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:14.068250 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8dd87275-8e93-4506-acc1-22c7f3c11324 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:14.068691 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8dd87275-8e93-4506-acc1-22c7f3c11324 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:14.072668 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:14.099004 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8dd87275-8e93-4506-acc1-22c7f3c11324 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:14.099454 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8dd87275-8e93-4506-acc1-22c7f3c11324 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:14.099899 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-8dd87275-8e93-4506-acc1-22c7f3c11324 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lazy-loading 'fault' on Instance uuid b87f710b-4cb8-4c2b-9377-c8bd9736329b {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:03:14.141383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-8dd87275-8e93-4506-acc1-22c7f3c11324 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:14.149099 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-8dd87275-8e93-4506-acc1-22c7f3c11324 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1304 microversion: 2.1 time: 0.094391 Aug 03 13:03:14.149662 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 252/527] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:14 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:03:14.968050 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-6a15cb16-5939-496a-969f-c6abac798990 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:14.968594 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-6a15cb16-5939-496a-969f-c6abac798990 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:14.975275 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6a15cb16-5939-496a-969f-c6abac798990 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:14.975736 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6a15cb16-5939-496a-969f-c6abac798990 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:14.976486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6a15cb16-5939-496a-969f-c6abac798990 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:14.976919 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6a15cb16-5939-496a-969f-c6abac798990 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:15.107161 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-6a15cb16-5939-496a-969f-c6abac798990 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:15.114545 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-6a15cb16-5939-496a-969f-c6abac798990 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1371 microversion: 2.1 time: 0.150377 Aug 03 13:03:15.115346 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 276/528] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:14 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:03:15.172761 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-39ed289a-3c6d-4695-aa99-37272319d504 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:15.173428 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-39ed289a-3c6d-4695-aa99-37272319d504 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:15.180727 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-39ed289a-3c6d-4695-aa99-37272319d504 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:15.181173 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-39ed289a-3c6d-4695-aa99-37272319d504 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:15.181928 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-39ed289a-3c6d-4695-aa99-37272319d504 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:15.182359 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-39ed289a-3c6d-4695-aa99-37272319d504 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:15.212871 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-39ed289a-3c6d-4695-aa99-37272319d504 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:15.213317 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-39ed289a-3c6d-4695-aa99-37272319d504 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:15.213751 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-39ed289a-3c6d-4695-aa99-37272319d504 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lazy-loading 'fault' on Instance uuid b87f710b-4cb8-4c2b-9377-c8bd9736329b {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:03:15.253674 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-39ed289a-3c6d-4695-aa99-37272319d504 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:15.261478 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-39ed289a-3c6d-4695-aa99-37272319d504 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1304 microversion: 2.1 time: 0.093137 Aug 03 13:03:15.271619 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 253/529] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:15 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:03:16.134415 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-b98c6d80-d722-4584-9054-6f57b99b00bb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:16.135053 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-b98c6d80-d722-4584-9054-6f57b99b00bb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:16.141081 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b98c6d80-d722-4584-9054-6f57b99b00bb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:16.141527 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b98c6d80-d722-4584-9054-6f57b99b00bb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:16.142283 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b98c6d80-d722-4584-9054-6f57b99b00bb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:16.142708 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b98c6d80-d722-4584-9054-6f57b99b00bb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:16.270956 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b98c6d80-d722-4584-9054-6f57b99b00bb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:16.278636 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-b98c6d80-d722-4584-9054-6f57b99b00bb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1371 microversion: 2.1 time: 0.147973 Aug 03 13:03:16.279243 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 277/530] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:16 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:03:16.283843 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e961ce88-8cb1-4503-822b-cc3c72b7ef61 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:16.284455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-e961ce88-8cb1-4503-822b-cc3c72b7ef61 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:16.291562 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e961ce88-8cb1-4503-822b-cc3c72b7ef61 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:16.292032 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e961ce88-8cb1-4503-822b-cc3c72b7ef61 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:16.292793 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e961ce88-8cb1-4503-822b-cc3c72b7ef61 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:16.294179 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e961ce88-8cb1-4503-822b-cc3c72b7ef61 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:16.323675 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e961ce88-8cb1-4503-822b-cc3c72b7ef61 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:16.324126 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e961ce88-8cb1-4503-822b-cc3c72b7ef61 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:16.324565 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-e961ce88-8cb1-4503-822b-cc3c72b7ef61 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lazy-loading 'fault' on Instance uuid b87f710b-4cb8-4c2b-9377-c8bd9736329b {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:03:16.368417 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-e961ce88-8cb1-4503-822b-cc3c72b7ef61 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:16.375744 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-e961ce88-8cb1-4503-822b-cc3c72b7ef61 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1304 microversion: 2.1 time: 0.095763 Aug 03 13:03:16.376315 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 254/531] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:16 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:03:17.299663 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-25b860eb-67ab-4ee3-9596-b73264b4f6ce tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:17.300377 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-25b860eb-67ab-4ee3-9596-b73264b4f6ce tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:17.307926 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-25b860eb-67ab-4ee3-9596-b73264b4f6ce tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:17.308366 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-25b860eb-67ab-4ee3-9596-b73264b4f6ce tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:17.309148 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-25b860eb-67ab-4ee3-9596-b73264b4f6ce tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:17.309573 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-25b860eb-67ab-4ee3-9596-b73264b4f6ce tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:17.395689 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-4db0aab6-a74b-4acc-821e-3b8fd01939a2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:17.396990 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-4db0aab6-a74b-4acc-821e-3b8fd01939a2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:17.405205 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4db0aab6-a74b-4acc-821e-3b8fd01939a2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:17.405934 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4db0aab6-a74b-4acc-821e-3b8fd01939a2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:17.408617 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4db0aab6-a74b-4acc-821e-3b8fd01939a2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:17.409277 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4db0aab6-a74b-4acc-821e-3b8fd01939a2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:17.443322 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-25b860eb-67ab-4ee3-9596-b73264b4f6ce tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:17.450121 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4db0aab6-a74b-4acc-821e-3b8fd01939a2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:17.450580 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4db0aab6-a74b-4acc-821e-3b8fd01939a2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:17.451501 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-4db0aab6-a74b-4acc-821e-3b8fd01939a2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lazy-loading 'fault' on Instance uuid b87f710b-4cb8-4c2b-9377-c8bd9736329b {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:03:17.453950 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-25b860eb-67ab-4ee3-9596-b73264b4f6ce tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1371 microversion: 2.1 time: 0.158046 Aug 03 13:03:17.467257 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 278/532] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:17 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:03:17.506133 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-4db0aab6-a74b-4acc-821e-3b8fd01939a2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fd9e0292fb4ebab755519ecc20235e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:17.513628 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-4db0aab6-a74b-4acc-821e-3b8fd01939a2 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 200 len: 1304 microversion: 2.1 time: 0.121902 Aug 03 13:03:17.514374 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 255/533] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:17 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:03:18.476004 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-819ce6d9-9a3f-4cf9-8a16-ce8611048e34 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:18.476633 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-819ce6d9-9a3f-4cf9-8a16-ce8611048e34 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:18.482721 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-819ce6d9-9a3f-4cf9-8a16-ce8611048e34 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:18.483187 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-819ce6d9-9a3f-4cf9-8a16-ce8611048e34 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:18.483930 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-819ce6d9-9a3f-4cf9-8a16-ce8611048e34 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:18.484356 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-819ce6d9-9a3f-4cf9-8a16-ce8611048e34 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:18.536050 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1a9fd3fb-011f-4d32-abd6-f4bfd7249ee1 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:18.536818 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-1a9fd3fb-011f-4d32-abd6-f4bfd7249ee1 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] [instance: b87f710b-4cb8-4c2b-9377-c8bd9736329b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:18.543526 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1a9fd3fb-011f-4d32-abd6-f4bfd7249ee1 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:18.543978 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1a9fd3fb-011f-4d32-abd6-f4bfd7249ee1 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:18.544752 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1a9fd3fb-011f-4d32-abd6-f4bfd7249ee1 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:18.545184 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1a9fd3fb-011f-4d32-abd6-f4bfd7249ee1 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:18.558915 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.wsgi [None req-1a9fd3fb-011f-4d32-abd6-f4bfd7249ee1 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] HTTP exception thrown: Instance b87f710b-4cb8-4c2b-9377-c8bd9736329b could not be found. Aug 03 13:03:18.560546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1a9fd3fb-011f-4d32-abd6-f4bfd7249ee1 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Request method failure captured: Aug 03 13:03:18.560546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: request: GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b HTTP/1.1 Aug 03 13:03:18.560546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept: application/json Aug 03 13:03:18.560546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept-Encoding: identity Aug 03 13:03:18.560546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Connection: close Aug 03 13:03:18.560546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Length: 0 Aug 03 13:03:18.560546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Type: application/json Aug 03 13:03:18.560546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Host: 10.222.0.64 Aug 03 13:03:18.560546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Openstack-System-Scope: None Aug 03 13:03:18.560546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: User-Agent: python-urllib3/1.26.10 Aug 03 13:03:18.560546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Auth-Token: gAAAAABi6nGMcOcAvHpr7PjcVPlTPIDoTbR-pmZ689KYk1_7V3Ctdt7HK6FzVuELUKU0JA4ttdwYTyogiNzRYlZS1Hzm6lhaTBgFojCdJraEm01gQqZcIr8KQGGL3L5HM__gWQIr5EJNWZ961xx_Mwsma-PhEL0EyQcTiBdhMA_Y3eQdT9Qmms8 Aug 03 13:03:18.560546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Id: None Aug 03 13:03:18.560546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Name: None Aug 03 13:03:18.560546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Identity-Status: Confirmed Aug 03 13:03:18.560546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Is-Admin-Project: True Aug 03 13:03:18.560546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Id: default Aug 03 13:03:18.560546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Name: Default Aug 03 13:03:18.560546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Id: ef1e829edd5a4a5f8c5133cb5e37c284 Aug 03 13:03:18.560546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Name: tempest-VolumesActionsTest-1749394077 Aug 03 13:03:18.560546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Role: member,reader Aug 03 13:03:18.560546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Roles: member,reader Aug 03 13:03:18.562053 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ef1e829edd5a4a5f8c5133cb5e37c284"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ef1e829edd5a4a5f8c5133cb5e37c284"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ef1e829edd5a4a5f8c5133cb5e37c284"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ef1e829edd5a4a5f8c5133cb5e37c284", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:03:18.562053 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant: tempest-VolumesActionsTest-1749394077 Aug 03 13:03:18.562053 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Id: ef1e829edd5a4a5f8c5133cb5e37c284 Aug 03 13:03:18.562053 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Name: tempest-VolumesActionsTest-1749394077 Aug 03 13:03:18.562053 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User: tempest-VolumesActionsTest-1749394077-project Aug 03 13:03:18.562053 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Id: default Aug 03 13:03:18.562053 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Name: Default Aug 03 13:03:18.562053 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Id: 79fd9e0292fb4ebab755519ecc20235e Aug 03 13:03:18.562053 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Name: tempest-VolumesActionsTest-1749394077-project Aug 03 13:03:18.562053 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: method: > Aug 03 13:03:18.562053 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: exception: Instance b87f710b-4cb8-4c2b-9377-c8bd9736329b could not be found. Aug 03 13:03:18.562053 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: action_args: {'id': 'b87f710b-4cb8-4c2b-9377-c8bd9736329b'} Aug 03 13:03:18.562948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:03:18.562948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:03:18.562948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:03:18.562948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:03:18.562948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:03:18.562948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:03:18.562948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:03:18.562948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:03:18.562948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:03:18.562948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:03:18.562948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b87f710b-4cb8-4c2b-9377-c8bd9736329b could not be found. Aug 03 13:03:18.562948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:03:18.562948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:03:18.562948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:03:18.562948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:03:18.562948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:03:18.562948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:03:18.562948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:03:18.562948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:03:18.562948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:03:18.565101 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:03:18.565101 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:03:18.565101 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:03:18.565101 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:03:18.565101 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:03:18.565101 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:03:18.565101 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:03:18.565101 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b87f710b-4cb8-4c2b-9377-c8bd9736329b could not be found. Aug 03 13:03:18.565101 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:03:18.565101 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:03:18.565101 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:03:18.565101 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:03:18.565101 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:03:18.565101 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:03:18.565101 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:03:18.565101 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:03:18.565101 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b87f710b-4cb8-4c2b-9377-c8bd9736329b could not be found. Aug 03 13:03:18.565101 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:03:18.566197 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1a9fd3fb-011f-4d32-abd6-f4bfd7249ee1 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] Returning 404 to user: Instance b87f710b-4cb8-4c2b-9377-c8bd9736329b could not be found. {{(pid=119410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:03:18.566197 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-1a9fd3fb-011f-4d32-abd6-f4bfd7249ee1 tempest-VolumesActionsTest-1749394077 tempest-VolumesActionsTest-1749394077-project] 10.222.0.64 "GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b" status: 404 len: 111 microversion: 2.1 time: 0.029794 Aug 03 13:03:18.566197 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 256/534] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:18 2022] GET /compute/v2.1/servers/b87f710b-4cb8-4c2b-9377-c8bd9736329b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 13:03:18.620301 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-819ce6d9-9a3f-4cf9-8a16-ce8611048e34 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:03:18.627777 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-819ce6d9-9a3f-4cf9-8a16-ce8611048e34 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1564 microversion: 2.1 time: 0.155753 Aug 03 13:03:18.628334 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 279/535] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:03:18 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:03:18.650413 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d801191f-c66d-4dc8-938a-b483a94a2bf4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:03:18.651025 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d801191f-c66d-4dc8-938a-b483a94a2bf4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:03:18.657469 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d801191f-c66d-4dc8-938a-b483a94a2bf4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:18.657968 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d801191f-c66d-4dc8-938a-b483a94a2bf4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:18.658806 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d801191f-c66d-4dc8-938a-b483a94a2bf4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:18.659338 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d801191f-c66d-4dc8-938a-b483a94a2bf4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:18.745814 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d801191f-c66d-4dc8-938a-b483a94a2bf4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099199 Aug 03 13:03:18.746944 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 257/536] 10.222.0.64 () {58 vars in 1275 bytes} [Wed Aug 3 13:03:18 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:03:19.790773 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-b44d03a3-4d56-4c05-92bc-b4bb16fbc897 req-b56cb00c-8e87-481e-978e-a99ea09e08bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76bb2b00-bafa-4b66-98f4-882ae210fe14", "tag": "9b3298cc-4607-4438-a82a-2051f630b8a0"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:03:19.800496 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-b44d03a3-4d56-4c05-92bc-b4bb16fbc897 req-b56cb00c-8e87-481e-978e-a99ea09e08bf service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:03:19.800946 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-b44d03a3-4d56-4c05-92bc-b4bb16fbc897 req-b56cb00c-8e87-481e-978e-a99ea09e08bf service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:03:19.816493 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-b44d03a3-4d56-4c05-92bc-b4bb16fbc897 req-b56cb00c-8e87-481e-978e-a99ea09e08bf service nova] Creating event network-changed:9b3298cc-4607-4438-a82a-2051f630b8a0 for instance 76bb2b00-bafa-4b66-98f4-882ae210fe14 on hv-cinder-85083 Aug 03 13:03:19.823420 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-b44d03a3-4d56-4c05-92bc-b4bb16fbc897 req-b56cb00c-8e87-481e-978e-a99ea09e08bf service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037462 Aug 03 13:03:19.823926 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 280/537] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:04:14.534605 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=19 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:14.535385 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=37 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:14.539366 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-ecfa51b8-142c-4228-a3f0-43b8bcd5620f tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2124145096", "imageRef": "c0aabcc0-d4af-4f0e-b8a5-d140344fce1f", "flavorRef": "452"}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:04:14.589762 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.network.neutron [None req-ecfa51b8-142c-4228-a3f0-43b8bcd5620f tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] validate_networks() for None {{(pid=119410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 13:04:15.014780 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=35 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:15.016164 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=64 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:15.021262 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-52a6c02b-d239-45ed-81e3-36b225bfa93f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:15.021861 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-52a6c02b-d239-45ed-81e3-36b225bfa93f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:15.028054 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-52a6c02b-d239-45ed-81e3-36b225bfa93f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:15.028698 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-52a6c02b-d239-45ed-81e3-36b225bfa93f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:15.029457 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-52a6c02b-d239-45ed-81e3-36b225bfa93f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:15.030061 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-52a6c02b-d239-45ed-81e3-36b225bfa93f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:15.054912 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-52a6c02b-d239-45ed-81e3-36b225bfa93f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a/ips" status: 200 len: 150 microversion: 2.1 time: 0.041202 Aug 03 13:04:15.055695 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 281/538] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Aug 3 13:04:15 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:04:15.086639 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-ecfa51b8-142c-4228-a3f0-43b8bcd5620f tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Flavor limits 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 13:04:15.087080 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-ecfa51b8-142c-4228-a3f0-43b8bcd5620f tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Image limits 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 13:04:15.087551 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-ecfa51b8-142c-4228-a3f0-43b8bcd5620f tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Flavor pref 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 13:04:15.087960 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-ecfa51b8-142c-4228-a3f0-43b8bcd5620f tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Image pref 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 13:04:15.088392 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-ecfa51b8-142c-4228-a3f0-43b8bcd5620f tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 13:04:15.098129 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ecfa51b8-142c-4228-a3f0-43b8bcd5620f tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:15.098580 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ecfa51b8-142c-4228-a3f0-43b8bcd5620f tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:15.099902 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ecfa51b8-142c-4228-a3f0-43b8bcd5620f tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:15.100341 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ecfa51b8-142c-4228-a3f0-43b8bcd5620f tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:15.122545 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.quota [None req-ecfa51b8-142c-4228-a3f0-43b8bcd5620f tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Getting quotas for project 13e4cf5597804239bfa60665a4aef3da. Resources: {'instances', 'ram', 'cores'} {{(pid=119410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 13:04:15.126831 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.quota [None req-ecfa51b8-142c-4228-a3f0-43b8bcd5620f tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Getting quotas for user 9e5912a78e824903b42eb3a4392688c8 and project 13e4cf5597804239bfa60665a4aef3da. Resources: {'instances', 'ram', 'cores'} {{(pid=119410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 13:04:15.138388 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-ecfa51b8-142c-4228-a3f0-43b8bcd5620f tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Going to run 1 instances... {{(pid=119410) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 13:04:15.140667 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-ecfa51b8-142c-4228-a3f0-43b8bcd5620f tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] [instance: 94bd67ea-f25b-40dc-9cb5-8601fef05fcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0aabcc0-d4af-4f0e-b8a5-d140344fce1f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 13:04:15.299198 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-ecfa51b8-142c-4228-a3f0-43b8bcd5620f tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.765971 Aug 03 13:04:15.299759 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 258/539] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 3 13:04:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 13:04:15.311006 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-0436a715-afcb-43a2-b33a-c192f6a52b7c tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:15.311616 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-0436a715-afcb-43a2-b33a-c192f6a52b7c tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] [instance: 94bd67ea-f25b-40dc-9cb5-8601fef05fcd] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:15.377459 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-0436a715-afcb-43a2-b33a-c192f6a52b7c tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5912a78e824903b42eb3a4392688c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e4cf5597804239bfa60665a4aef3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:15.384815 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-0436a715-afcb-43a2-b33a-c192f6a52b7c tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] 10.222.0.64 "GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd" status: 200 len: 1215 microversion: 2.1 time: 0.077648 Aug 03 13:04:15.385374 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 282/540] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:15 2022] GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd => generated 1215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:04:16.405834 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-0aaa4d22-deb4-4381-aa40-bcae5a762acd tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:16.406539 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-0aaa4d22-deb4-4381-aa40-bcae5a762acd tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] [instance: 94bd67ea-f25b-40dc-9cb5-8601fef05fcd] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:16.469936 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-0aaa4d22-deb4-4381-aa40-bcae5a762acd tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5912a78e824903b42eb3a4392688c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e4cf5597804239bfa60665a4aef3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:16.469936 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-0aaa4d22-deb4-4381-aa40-bcae5a762acd tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] 10.222.0.64 "GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd" status: 200 len: 1215 microversion: 2.1 time: 0.067919 Aug 03 13:04:16.470517 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 259/541] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:16 2022] GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd => generated 1215 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:04:17.493030 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-091b11e3-536c-493b-a21a-5d16ed8ee7c8 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:17.493640 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-091b11e3-536c-493b-a21a-5d16ed8ee7c8 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] [instance: 94bd67ea-f25b-40dc-9cb5-8601fef05fcd] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:17.499837 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-091b11e3-536c-493b-a21a-5d16ed8ee7c8 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:17.500286 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-091b11e3-536c-493b-a21a-5d16ed8ee7c8 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:17.501041 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-091b11e3-536c-493b-a21a-5d16ed8ee7c8 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:17.501509 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-091b11e3-536c-493b-a21a-5d16ed8ee7c8 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:17.563800 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-091b11e3-536c-493b-a21a-5d16ed8ee7c8 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5912a78e824903b42eb3a4392688c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e4cf5597804239bfa60665a4aef3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:17.572210 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-091b11e3-536c-493b-a21a-5d16ed8ee7c8 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] 10.222.0.64 "GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd" status: 200 len: 1267 microversion: 2.1 time: 0.082901 Aug 03 13:04:17.573394 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 283/542] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:17 2022] GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd => generated 1267 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:04:17.911594 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-3a69311c-1aa5-42fe-b039-ba0ba881b5d2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64fa4683-5a6a-4a70-a1a1-624bd9d88dea"}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:04:17.917189 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-3a69311c-1aa5-42fe-b039-ba0ba881b5d2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:17.921203 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3a69311c-1aa5-42fe-b039-ba0ba881b5d2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:17.921659 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3a69311c-1aa5-42fe-b039-ba0ba881b5d2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:17.922439 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3a69311c-1aa5-42fe-b039-ba0ba881b5d2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:17.922904 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3a69311c-1aa5-42fe-b039-ba0ba881b5d2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:18.596081 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-2a06c298-f073-4b8f-899c-79476f665bf4 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:18.596936 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-2a06c298-f073-4b8f-899c-79476f665bf4 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] [instance: 94bd67ea-f25b-40dc-9cb5-8601fef05fcd] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:18.604140 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2a06c298-f073-4b8f-899c-79476f665bf4 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:18.604720 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2a06c298-f073-4b8f-899c-79476f665bf4 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:18.605573 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2a06c298-f073-4b8f-899c-79476f665bf4 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:18.606084 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2a06c298-f073-4b8f-899c-79476f665bf4 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:18.671342 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-2a06c298-f073-4b8f-899c-79476f665bf4 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5912a78e824903b42eb3a4392688c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e4cf5597804239bfa60665a4aef3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:18.679658 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-2a06c298-f073-4b8f-899c-79476f665bf4 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] 10.222.0.64 "GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd" status: 200 len: 1273 microversion: 2.1 time: 0.088464 Aug 03 13:04:18.680482 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 284/543] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:18 2022] GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd => generated 1273 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:04:18.757476 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-3a69311c-1aa5-42fe-b039-ba0ba881b5d2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "POST /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.849828 Aug 03 13:04:18.758104 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 260/544] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Aug 3 13:04:17 2022] POST /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a/os-volume_attachments => generated 194 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:04:19.701338 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-a2c9b360-aa05-468f-b551-d6aaa3e006bf tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:19.701942 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-a2c9b360-aa05-468f-b551-d6aaa3e006bf tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] [instance: 94bd67ea-f25b-40dc-9cb5-8601fef05fcd] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:19.709764 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a2c9b360-aa05-468f-b551-d6aaa3e006bf tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:19.710208 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a2c9b360-aa05-468f-b551-d6aaa3e006bf tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:19.711206 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a2c9b360-aa05-468f-b551-d6aaa3e006bf tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:19.712518 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a2c9b360-aa05-468f-b551-d6aaa3e006bf tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:19.850135 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-a2c9b360-aa05-468f-b551-d6aaa3e006bf tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5912a78e824903b42eb3a4392688c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e4cf5597804239bfa60665a4aef3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:19.858086 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-a2c9b360-aa05-468f-b551-d6aaa3e006bf tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] 10.222.0.64 "GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd" status: 200 len: 1315 microversion: 2.1 time: 0.160864 Aug 03 13:04:19.858660 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 285/545] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:19 2022] GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:04:19.907763 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-404b6152-ec7f-4206-8b2a-3fdc1e4bf5e3 req-750bc15f-2698-437c-b6ec-70c5ce8541d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94bd67ea-f25b-40dc-9cb5-8601fef05fcd", "tag": "84f17796-5680-4ac7-920f-7616db3d1477"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:04:19.921214 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-404b6152-ec7f-4206-8b2a-3fdc1e4bf5e3 req-750bc15f-2698-437c-b6ec-70c5ce8541d6 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:19.921733 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-404b6152-ec7f-4206-8b2a-3fdc1e4bf5e3 req-750bc15f-2698-437c-b6ec-70c5ce8541d6 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:19.933889 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-404b6152-ec7f-4206-8b2a-3fdc1e4bf5e3 req-750bc15f-2698-437c-b6ec-70c5ce8541d6 service nova] Creating event network-changed:84f17796-5680-4ac7-920f-7616db3d1477 for instance 94bd67ea-f25b-40dc-9cb5-8601fef05fcd on hv-cinder-85083 Aug 03 13:04:19.938578 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-404b6152-ec7f-4206-8b2a-3fdc1e4bf5e3 req-750bc15f-2698-437c-b6ec-70c5ce8541d6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035735 Aug 03 13:04:19.939201 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 261/546] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:04:20.879710 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-9fc79c63-035d-4f82-8167-ace6660988a8 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:20.880461 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-9fc79c63-035d-4f82-8167-ace6660988a8 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] [instance: 94bd67ea-f25b-40dc-9cb5-8601fef05fcd] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:20.886645 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9fc79c63-035d-4f82-8167-ace6660988a8 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:20.887179 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9fc79c63-035d-4f82-8167-ace6660988a8 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:20.888008 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9fc79c63-035d-4f82-8167-ace6660988a8 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:20.888444 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9fc79c63-035d-4f82-8167-ace6660988a8 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:21.019395 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-9fc79c63-035d-4f82-8167-ace6660988a8 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5912a78e824903b42eb3a4392688c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e4cf5597804239bfa60665a4aef3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:21.027373 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-9fc79c63-035d-4f82-8167-ace6660988a8 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] 10.222.0.64 "GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd" status: 200 len: 1315 microversion: 2.1 time: 0.152010 Aug 03 13:04:21.027965 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 286/547] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:20 2022] GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:04:22.049756 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-3cbd2633-b04f-4365-817c-abc57fa55faa tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:22.050489 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-3cbd2633-b04f-4365-817c-abc57fa55faa tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] [instance: 94bd67ea-f25b-40dc-9cb5-8601fef05fcd] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:22.057243 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3cbd2633-b04f-4365-817c-abc57fa55faa tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:22.057685 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3cbd2633-b04f-4365-817c-abc57fa55faa tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:22.058432 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3cbd2633-b04f-4365-817c-abc57fa55faa tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:22.058890 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3cbd2633-b04f-4365-817c-abc57fa55faa tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:22.196408 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-3cbd2633-b04f-4365-817c-abc57fa55faa tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5912a78e824903b42eb3a4392688c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e4cf5597804239bfa60665a4aef3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:22.204568 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-3cbd2633-b04f-4365-817c-abc57fa55faa tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] 10.222.0.64 "GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd" status: 200 len: 1315 microversion: 2.1 time: 0.159325 Aug 03 13:04:22.205102 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 262/548] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:22 2022] GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:04:23.117078 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-725d9797-0847-43ce-b4e9-3f28460369ba tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:23.117617 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-725d9797-0847-43ce-b4e9-3f28460369ba tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:23.123919 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-725d9797-0847-43ce-b4e9-3f28460369ba tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:23.124364 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-725d9797-0847-43ce-b4e9-3f28460369ba tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:23.125115 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-725d9797-0847-43ce-b4e9-3f28460369ba tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:23.125653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-725d9797-0847-43ce-b4e9-3f28460369ba tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:23.149446 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-725d9797-0847-43ce-b4e9-3f28460369ba tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1/ips" status: 200 len: 152 microversion: 2.20 time: 0.036684 Aug 03 13:04:23.150006 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 287/549] 10.222.0.64 () {60 vars in 1289 bytes} [Wed Aug 3 13:04:23 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 13:04:23.225760 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-bc129d47-bc1a-4ce7-95b7-743f56151cf5 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:23.226371 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-bc129d47-bc1a-4ce7-95b7-743f56151cf5 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] [instance: 94bd67ea-f25b-40dc-9cb5-8601fef05fcd] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:23.232884 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bc129d47-bc1a-4ce7-95b7-743f56151cf5 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:23.233345 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bc129d47-bc1a-4ce7-95b7-743f56151cf5 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:23.234114 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bc129d47-bc1a-4ce7-95b7-743f56151cf5 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:23.234543 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bc129d47-bc1a-4ce7-95b7-743f56151cf5 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:23.537698 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-bc129d47-bc1a-4ce7-95b7-743f56151cf5 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5912a78e824903b42eb3a4392688c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e4cf5597804239bfa60665a4aef3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:23.545149 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-bc129d47-bc1a-4ce7-95b7-743f56151cf5 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] 10.222.0.64 "GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd" status: 200 len: 1315 microversion: 2.1 time: 0.323231 Aug 03 13:04:23.545717 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 263/550] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:23 2022] GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:04:24.567021 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-409495c9-a85c-48e2-bfcd-cf49df1d7af1 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:24.567725 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-409495c9-a85c-48e2-bfcd-cf49df1d7af1 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] [instance: 94bd67ea-f25b-40dc-9cb5-8601fef05fcd] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:24.574175 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-409495c9-a85c-48e2-bfcd-cf49df1d7af1 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:24.574618 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-409495c9-a85c-48e2-bfcd-cf49df1d7af1 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:24.575402 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-409495c9-a85c-48e2-bfcd-cf49df1d7af1 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:24.575837 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-409495c9-a85c-48e2-bfcd-cf49df1d7af1 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:24.755023 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-409495c9-a85c-48e2-bfcd-cf49df1d7af1 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5912a78e824903b42eb3a4392688c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e4cf5597804239bfa60665a4aef3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:24.763008 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-409495c9-a85c-48e2-bfcd-cf49df1d7af1 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] 10.222.0.64 "GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd" status: 200 len: 1315 microversion: 2.1 time: 0.200196 Aug 03 13:04:24.763615 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 288/551] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:24 2022] GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:04:25.783713 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-3a4f12b7-8924-456a-9c1d-ddb979dd1928 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:25.784320 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-3a4f12b7-8924-456a-9c1d-ddb979dd1928 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] [instance: 94bd67ea-f25b-40dc-9cb5-8601fef05fcd] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:25.786686 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=2 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:25.791456 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3a4f12b7-8924-456a-9c1d-ddb979dd1928 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:25.791903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3a4f12b7-8924-456a-9c1d-ddb979dd1928 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:25.792651 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3a4f12b7-8924-456a-9c1d-ddb979dd1928 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:25.793079 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3a4f12b7-8924-456a-9c1d-ddb979dd1928 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:25.961162 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-3a4f12b7-8924-456a-9c1d-ddb979dd1928 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5912a78e824903b42eb3a4392688c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e4cf5597804239bfa60665a4aef3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:25.969266 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-3a4f12b7-8924-456a-9c1d-ddb979dd1928 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] 10.222.0.64 "GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd" status: 200 len: 1315 microversion: 2.1 time: 0.189528 Aug 03 13:04:25.969838 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 264/552] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:25 2022] GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:04:26.552921 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-fcf5f968-4113-4fc9-b87e-04cc54038aaa tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:04:26.553457 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-fcf5f968-4113-4fc9-b87e-04cc54038aaa tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:26.555391 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell0:SELECT=2 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:26.560422 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fcf5f968-4113-4fc9-b87e-04cc54038aaa tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:26.561126 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fcf5f968-4113-4fc9-b87e-04cc54038aaa tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:26.562011 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fcf5f968-4113-4fc9-b87e-04cc54038aaa tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:26.562444 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fcf5f968-4113-4fc9-b87e-04cc54038aaa tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:26.585500 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.objects.instance [None req-fcf5f968-4113-4fc9-b87e-04cc54038aaa tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lazy-loading 'flavor' on Instance uuid 67e92b94-74d5-4161-ab5d-80b10c84bfb1 {{(pid=119409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:04:26.989411 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-2109a74d-6857-46cf-9181-cb7e908ab13a tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:26.990129 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-2109a74d-6857-46cf-9181-cb7e908ab13a tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] [instance: 94bd67ea-f25b-40dc-9cb5-8601fef05fcd] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:26.992636 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=8 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:26.999213 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2109a74d-6857-46cf-9181-cb7e908ab13a tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:26.999852 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2109a74d-6857-46cf-9181-cb7e908ab13a tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:27.000931 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2109a74d-6857-46cf-9181-cb7e908ab13a tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:27.001541 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2109a74d-6857-46cf-9181-cb7e908ab13a tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:27.144308 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-fcf5f968-4113-4fc9-b87e-04cc54038aaa tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "POST /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1/action" status: 202 len: 0 microversion: 2.20 time: 0.595827 Aug 03 13:04:27.144946 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 289/553] 10.222.0.64 () {62 vars in 1319 bytes} [Wed Aug 3 13:04:26 2022] POST /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 13:04:27.157065 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-cc21d729-8d5c-4e0a-881f-3100fd8df51b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:27.159678 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-cc21d729-8d5c-4e0a-881f-3100fd8df51b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:27.163919 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-2109a74d-6857-46cf-9181-cb7e908ab13a tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5912a78e824903b42eb3a4392688c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e4cf5597804239bfa60665a4aef3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:27.167881 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-cc21d729-8d5c-4e0a-881f-3100fd8df51b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:27.171103 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-cc21d729-8d5c-4e0a-881f-3100fd8df51b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:27.171103 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-cc21d729-8d5c-4e0a-881f-3100fd8df51b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:27.171103 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-cc21d729-8d5c-4e0a-881f-3100fd8df51b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:27.173541 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-2109a74d-6857-46cf-9181-cb7e908ab13a tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] 10.222.0.64 "GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd" status: 200 len: 1315 microversion: 2.1 time: 0.187886 Aug 03 13:04:27.184005 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 265/554] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:26 2022] GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:04:27.316222 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-cc21d729-8d5c-4e0a-881f-3100fd8df51b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:27.324786 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-cc21d729-8d5c-4e0a-881f-3100fd8df51b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:27.326281 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-cc21d729-8d5c-4e0a-881f-3100fd8df51b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:27.327523 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-cc21d729-8d5c-4e0a-881f-3100fd8df51b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1724 microversion: 2.20 time: 0.177096 Aug 03 13:04:27.328819 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 290/555] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:04:27 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:04:27.369057 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-3660125e-ebd0-4771-97cd-5dd7c40255d5 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Action: 'create', calling method: .version_select at 0x7fe6d80ffb80>, body: {"keypair": {"name": "tempest-keypair-1561300594", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRb8ioFm0eNHMefmIo6K5OTxWCc7+caD51aWB4iDpXNvMOeHC6E1CDZm5gvfhPAdLpKx1dx940ef4xNGWud4v0o+Xhp9U8tfDMPlM124iB0m86LLEyuzjSPGrlaWtjRAA=="}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:04:27.384700 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.quota [None req-3660125e-ebd0-4771-97cd-5dd7c40255d5 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Getting quotas for project 23cfcb8de5e448b8af185376a035263b. Resources: {'key_pairs'} {{(pid=119410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 13:04:27.388444 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.quota [None req-3660125e-ebd0-4771-97cd-5dd7c40255d5 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Getting quotas for user 36693fa42a7b41279c8d8c59ecafb243 and project 23cfcb8de5e448b8af185376a035263b. Resources: {'key_pairs'} {{(pid=119410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 13:04:27.460005 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-3660125e-ebd0-4771-97cd-5dd7c40255d5 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.094651 Aug 03 13:04:27.460669 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 266/556] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Aug 3 13:04:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:04:28.193854 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-88328bb6-775a-499e-9e02-e1243cfc2793 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:28.194457 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-88328bb6-775a-499e-9e02-e1243cfc2793 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] [instance: 94bd67ea-f25b-40dc-9cb5-8601fef05fcd] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:28.200479 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-88328bb6-775a-499e-9e02-e1243cfc2793 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:28.200920 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-88328bb6-775a-499e-9e02-e1243cfc2793 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:28.201663 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-88328bb6-775a-499e-9e02-e1243cfc2793 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:28.202112 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-88328bb6-775a-499e-9e02-e1243cfc2793 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:28.355154 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-fab033d7-845c-49be-8e04-05d92d95d9fa tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:28.357827 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-fab033d7-845c-49be-8e04-05d92d95d9fa tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:28.367401 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fab033d7-845c-49be-8e04-05d92d95d9fa tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:28.368100 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fab033d7-845c-49be-8e04-05d92d95d9fa tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:28.370203 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fab033d7-845c-49be-8e04-05d92d95d9fa tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:28.370851 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fab033d7-845c-49be-8e04-05d92d95d9fa tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:28.385824 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-88328bb6-775a-499e-9e02-e1243cfc2793 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5912a78e824903b42eb3a4392688c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e4cf5597804239bfa60665a4aef3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:28.398172 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-88328bb6-775a-499e-9e02-e1243cfc2793 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] 10.222.0.64 "GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd" status: 200 len: 1315 microversion: 2.1 time: 0.205008 Aug 03 13:04:28.414155 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 291/557] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:28 2022] GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:04:28.487333 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-48810ce3-e2ca-429e-8ffa-d808c721db26 req-7d94ca61-447f-4574-9fa0-1b915c6415f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94bd67ea-f25b-40dc-9cb5-8601fef05fcd", "name": "network-vif-plugged", "status": "completed", "tag": "84f17796-5680-4ac7-920f-7616db3d1477"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:04:28.497763 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-48810ce3-e2ca-429e-8ffa-d808c721db26 req-7d94ca61-447f-4574-9fa0-1b915c6415f8 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:28.498212 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-48810ce3-e2ca-429e-8ffa-d808c721db26 req-7d94ca61-447f-4574-9fa0-1b915c6415f8 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:28.511918 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-48810ce3-e2ca-429e-8ffa-d808c721db26 req-7d94ca61-447f-4574-9fa0-1b915c6415f8 service nova] Creating event network-vif-plugged:84f17796-5680-4ac7-920f-7616db3d1477 for instance 94bd67ea-f25b-40dc-9cb5-8601fef05fcd on hv-cinder-85083 Aug 03 13:04:28.517554 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-48810ce3-e2ca-429e-8ffa-d808c721db26 req-7d94ca61-447f-4574-9fa0-1b915c6415f8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034204 Aug 03 13:04:28.520851 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 292/558] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:04:28.550767 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-fab033d7-845c-49be-8e04-05d92d95d9fa tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:28.558787 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-fab033d7-845c-49be-8e04-05d92d95d9fa tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:28.560342 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-fab033d7-845c-49be-8e04-05d92d95d9fa tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:28.561560 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-fab033d7-845c-49be-8e04-05d92d95d9fa tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1724 microversion: 2.20 time: 0.212119 Aug 03 13:04:28.562114 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 267/559] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:04:28 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:04:29.419203 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-8bcbd799-6ac4-48ed-9521-48312d46e922 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:29.419901 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-8bcbd799-6ac4-48ed-9521-48312d46e922 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] [instance: 94bd67ea-f25b-40dc-9cb5-8601fef05fcd] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:29.426094 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8bcbd799-6ac4-48ed-9521-48312d46e922 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:29.426546 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8bcbd799-6ac4-48ed-9521-48312d46e922 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:29.427336 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8bcbd799-6ac4-48ed-9521-48312d46e922 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:29.427784 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8bcbd799-6ac4-48ed-9521-48312d46e922 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:29.585122 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-12eec7da-0ad7-4a35-85ab-658f8ab424be tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:29.585835 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-12eec7da-0ad7-4a35-85ab-658f8ab424be tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:29.592528 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-12eec7da-0ad7-4a35-85ab-658f8ab424be tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:29.593052 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-12eec7da-0ad7-4a35-85ab-658f8ab424be tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:29.593876 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-12eec7da-0ad7-4a35-85ab-658f8ab424be tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:29.594376 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-12eec7da-0ad7-4a35-85ab-658f8ab424be tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:29.688698 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-8bcbd799-6ac4-48ed-9521-48312d46e922 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5912a78e824903b42eb3a4392688c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e4cf5597804239bfa60665a4aef3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:29.697284 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-8bcbd799-6ac4-48ed-9521-48312d46e922 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] 10.222.0.64 "GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd" status: 200 len: 1315 microversion: 2.1 time: 0.282329 Aug 03 13:04:29.697957 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 293/560] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:29 2022] GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:04:29.782105 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-12eec7da-0ad7-4a35-85ab-658f8ab424be tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:29.789882 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-12eec7da-0ad7-4a35-85ab-658f8ab424be tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:29.791440 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-12eec7da-0ad7-4a35-85ab-658f8ab424be tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:29.792584 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-12eec7da-0ad7-4a35-85ab-658f8ab424be tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1724 microversion: 2.20 time: 0.211657 Aug 03 13:04:29.793144 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 268/561] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:04:29 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:04:30.068564 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-73b1b2ae-f882-4e5f-aaaa-beecc689df80 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1955559866", "imageRef": "c0aabcc0-d4af-4f0e-b8a5-d140344fce1f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "62a2a8c1-4047-4249-9eca-1b469b6efbc6"}], "security_groups": [{"name": "tempest-securitygroup--1188556777"}], "key_name": "tempest-keypair-1561300594", "user_data": "}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:04:30.173767 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.network.neutron [None req-73b1b2ae-f882-4e5f-aaaa-beecc689df80 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] validate_networks() for [('62a2a8c1-4047-4249-9eca-1b469b6efbc6', None, None, None, None, None)] {{(pid=119409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 13:04:30.554042 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-73b1b2ae-f882-4e5f-aaaa-beecc689df80 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Flavor limits 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 13:04:30.554631 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-73b1b2ae-f882-4e5f-aaaa-beecc689df80 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Image limits 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 13:04:30.554963 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-73b1b2ae-f882-4e5f-aaaa-beecc689df80 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Flavor pref 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 13:04:30.555411 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-73b1b2ae-f882-4e5f-aaaa-beecc689df80 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Image pref 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 13:04:30.555823 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-73b1b2ae-f882-4e5f-aaaa-beecc689df80 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 13:04:30.566063 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-73b1b2ae-f882-4e5f-aaaa-beecc689df80 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:30.566511 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-73b1b2ae-f882-4e5f-aaaa-beecc689df80 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:30.567369 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-73b1b2ae-f882-4e5f-aaaa-beecc689df80 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:30.567912 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-73b1b2ae-f882-4e5f-aaaa-beecc689df80 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:30.587119 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-73b1b2ae-f882-4e5f-aaaa-beecc689df80 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Getting quotas for project 23cfcb8de5e448b8af185376a035263b. Resources: {'instances', 'ram', 'cores'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 13:04:30.591894 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-73b1b2ae-f882-4e5f-aaaa-beecc689df80 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Getting quotas for user 36693fa42a7b41279c8d8c59ecafb243 and project 23cfcb8de5e448b8af185376a035263b. Resources: {'instances', 'ram', 'cores'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 13:04:30.605351 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-73b1b2ae-f882-4e5f-aaaa-beecc689df80 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Going to run 1 instances... {{(pid=119409) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 13:04:30.607650 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-73b1b2ae-f882-4e5f-aaaa-beecc689df80 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 5079c8f3-b98d-4036-987d-fcac401752ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0aabcc0-d4af-4f0e-b8a5-d140344fce1f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 13:04:30.719723 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-abd0da53-fd45-43a8-a3ae-503d18704bc6 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:30.720667 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-abd0da53-fd45-43a8-a3ae-503d18704bc6 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] [instance: 94bd67ea-f25b-40dc-9cb5-8601fef05fcd] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:30.727814 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-abd0da53-fd45-43a8-a3ae-503d18704bc6 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:30.728442 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-abd0da53-fd45-43a8-a3ae-503d18704bc6 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:30.729201 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-abd0da53-fd45-43a8-a3ae-503d18704bc6 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:30.729635 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-abd0da53-fd45-43a8-a3ae-503d18704bc6 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:30.762698 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-73b1b2ae-f882-4e5f-aaaa-beecc689df80 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.698560 Aug 03 13:04:30.764073 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 294/562] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 3 13:04:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 13:04:30.775368 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-1376a2c8-e20b-4a1c-a148-0ac3905776cc tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:30.776180 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-1376a2c8-e20b-4a1c-a148-0ac3905776cc tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 5079c8f3-b98d-4036-987d-fcac401752ed] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:30.853395 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-1376a2c8-e20b-4a1c-a148-0ac3905776cc tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:30.860858 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-1376a2c8-e20b-4a1c-a148-0ac3905776cc tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed" status: 200 len: 1242 microversion: 2.1 time: 0.090176 Aug 03 13:04:30.861553 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 295/563] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:30 2022] GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:04:30.880221 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-c29dd043-2f44-4c51-aa5b-d2f0bbe12e2e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:30.880839 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-c29dd043-2f44-4c51-aa5b-d2f0bbe12e2e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:30.888322 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c29dd043-2f44-4c51-aa5b-d2f0bbe12e2e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:30.888777 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c29dd043-2f44-4c51-aa5b-d2f0bbe12e2e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:30.889555 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c29dd043-2f44-4c51-aa5b-d2f0bbe12e2e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:30.889987 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c29dd043-2f44-4c51-aa5b-d2f0bbe12e2e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:30.900231 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-abd0da53-fd45-43a8-a3ae-503d18704bc6 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5912a78e824903b42eb3a4392688c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e4cf5597804239bfa60665a4aef3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:30.909883 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-abd0da53-fd45-43a8-a3ae-503d18704bc6 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] 10.222.0.64 "GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd" status: 200 len: 1315 microversion: 2.1 time: 0.195350 Aug 03 13:04:30.924049 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 269/564] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:30 2022] GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:04:31.027673 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-c29dd043-2f44-4c51-aa5b-d2f0bbe12e2e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:31.035846 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-c29dd043-2f44-4c51-aa5b-d2f0bbe12e2e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:31.037436 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-c29dd043-2f44-4c51-aa5b-d2f0bbe12e2e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:31.038521 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-c29dd043-2f44-4c51-aa5b-d2f0bbe12e2e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1724 microversion: 2.20 time: 0.165849 Aug 03 13:04:31.039122 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 296/565] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:04:30 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:04:31.885493 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-7be3347d-07ac-4dbd-942c-1ab9040778d9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:31.886092 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-7be3347d-07ac-4dbd-942c-1ab9040778d9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 5079c8f3-b98d-4036-987d-fcac401752ed] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:31.892986 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7be3347d-07ac-4dbd-942c-1ab9040778d9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:31.893643 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7be3347d-07ac-4dbd-942c-1ab9040778d9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:31.894444 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7be3347d-07ac-4dbd-942c-1ab9040778d9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:31.894918 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7be3347d-07ac-4dbd-942c-1ab9040778d9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:31.929882 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-b81bba84-4703-494b-9e49-319a0f33ef46 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:31.930597 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-b81bba84-4703-494b-9e49-319a0f33ef46 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] [instance: 94bd67ea-f25b-40dc-9cb5-8601fef05fcd] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:31.936833 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b81bba84-4703-494b-9e49-319a0f33ef46 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:31.937208 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b81bba84-4703-494b-9e49-319a0f33ef46 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:31.937975 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b81bba84-4703-494b-9e49-319a0f33ef46 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:31.938410 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b81bba84-4703-494b-9e49-319a0f33ef46 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:31.957053 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-7be3347d-07ac-4dbd-942c-1ab9040778d9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:31.964822 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-7be3347d-07ac-4dbd-942c-1ab9040778d9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed" status: 200 len: 1246 microversion: 2.1 time: 0.083288 Aug 03 13:04:31.965576 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 270/566] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:31 2022] GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:04:32.062340 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-ae8d797e-ab2d-402e-b8b3-a8bda29aca25 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:32.063029 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-ae8d797e-ab2d-402e-b8b3-a8bda29aca25 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:32.069065 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b81bba84-4703-494b-9e49-319a0f33ef46 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5912a78e824903b42eb3a4392688c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e4cf5597804239bfa60665a4aef3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:32.069875 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ae8d797e-ab2d-402e-b8b3-a8bda29aca25 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:32.070603 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ae8d797e-ab2d-402e-b8b3-a8bda29aca25 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:32.071418 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ae8d797e-ab2d-402e-b8b3-a8bda29aca25 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:32.071914 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ae8d797e-ab2d-402e-b8b3-a8bda29aca25 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:32.077796 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-b81bba84-4703-494b-9e49-319a0f33ef46 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] 10.222.0.64 "GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd" status: 200 len: 1464 microversion: 2.1 time: 0.151042 Aug 03 13:04:32.086346 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 297/567] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:31 2022] GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd => generated 1464 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:04:32.123631 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-f87c5cf1-1dcd-4321-9c7c-b4f5c3e9c097 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:32.124168 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-f87c5cf1-1dcd-4321-9c7c-b4f5c3e9c097 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] [instance: 94bd67ea-f25b-40dc-9cb5-8601fef05fcd] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:32.130277 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f87c5cf1-1dcd-4321-9c7c-b4f5c3e9c097 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:32.130720 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f87c5cf1-1dcd-4321-9c7c-b4f5c3e9c097 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:32.131508 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f87c5cf1-1dcd-4321-9c7c-b4f5c3e9c097 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:32.131964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f87c5cf1-1dcd-4321-9c7c-b4f5c3e9c097 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:32.160185 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-f87c5cf1-1dcd-4321-9c7c-b4f5c3e9c097 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] [instance: 94bd67ea-f25b-40dc-9cb5-8601fef05fcd] Going to try to terminate instance {{(pid=119409) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 13:04:32.191545 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:32.207411 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ae8d797e-ab2d-402e-b8b3-a8bda29aca25 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:32.215910 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ae8d797e-ab2d-402e-b8b3-a8bda29aca25 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:32.217413 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ae8d797e-ab2d-402e-b8b3-a8bda29aca25 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:32.218566 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-ae8d797e-ab2d-402e-b8b3-a8bda29aca25 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1724 microversion: 2.20 time: 0.161031 Aug 03 13:04:32.219328 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 271/568] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:04:32 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:04:32.463668 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-f87c5cf1-1dcd-4321-9c7c-b4f5c3e9c097 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] 10.222.0.64 "DELETE /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd" status: 204 len: 0 microversion: 2.1 time: 0.343607 Aug 03 13:04:32.464250 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 298/569] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 3 13:04:32 2022] DELETE /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 13:04:32.473066 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d8256ec1-098a-4ff9-bc36-7c1b67d95635 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:32.473688 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d8256ec1-098a-4ff9-bc36-7c1b67d95635 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] [instance: 94bd67ea-f25b-40dc-9cb5-8601fef05fcd] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:32.479773 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d8256ec1-098a-4ff9-bc36-7c1b67d95635 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:32.480225 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d8256ec1-098a-4ff9-bc36-7c1b67d95635 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:32.481143 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d8256ec1-098a-4ff9-bc36-7c1b67d95635 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:32.481586 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d8256ec1-098a-4ff9-bc36-7c1b67d95635 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:32.617226 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d8256ec1-098a-4ff9-bc36-7c1b67d95635 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5912a78e824903b42eb3a4392688c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e4cf5597804239bfa60665a4aef3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:32.624751 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d8256ec1-098a-4ff9-bc36-7c1b67d95635 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] 10.222.0.64 "GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd" status: 200 len: 1470 microversion: 2.1 time: 0.156361 Aug 03 13:04:32.625317 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 272/570] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:32 2022] GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:04:32.992039 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-dcc68cd6-c44b-4b5e-a3ba-526fe0642f85 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:32.992039 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-dcc68cd6-c44b-4b5e-a3ba-526fe0642f85 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 5079c8f3-b98d-4036-987d-fcac401752ed] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:32.993937 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-dcc68cd6-c44b-4b5e-a3ba-526fe0642f85 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:32.994392 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-dcc68cd6-c44b-4b5e-a3ba-526fe0642f85 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:32.995191 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-dcc68cd6-c44b-4b5e-a3ba-526fe0642f85 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:32.995617 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-dcc68cd6-c44b-4b5e-a3ba-526fe0642f85 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:33.057562 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-dcc68cd6-c44b-4b5e-a3ba-526fe0642f85 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:33.065341 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-dcc68cd6-c44b-4b5e-a3ba-526fe0642f85 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed" status: 200 len: 1294 microversion: 2.1 time: 0.083022 Aug 03 13:04:33.065911 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 299/571] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:32 2022] GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed => generated 1294 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:04:33.242724 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e6580148-7b67-4818-888f-660eee2e0c72 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:33.243310 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-e6580148-7b67-4818-888f-660eee2e0c72 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:33.249888 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e6580148-7b67-4818-888f-660eee2e0c72 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:33.250346 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e6580148-7b67-4818-888f-660eee2e0c72 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:33.251151 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e6580148-7b67-4818-888f-660eee2e0c72 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:33.251589 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e6580148-7b67-4818-888f-660eee2e0c72 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:33.378929 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-e6580148-7b67-4818-888f-660eee2e0c72 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:33.386692 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-e6580148-7b67-4818-888f-660eee2e0c72 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:33.388193 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-e6580148-7b67-4818-888f-660eee2e0c72 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:33.389329 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-e6580148-7b67-4818-888f-660eee2e0c72 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1724 microversion: 2.20 time: 0.151445 Aug 03 13:04:33.389877 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 273/572] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:04:33 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:04:33.646592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-953b8225-e8d4-4adf-a206-47df1a3e1c66 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:33.647236 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-953b8225-e8d4-4adf-a206-47df1a3e1c66 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] [instance: 94bd67ea-f25b-40dc-9cb5-8601fef05fcd] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:33.653745 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-953b8225-e8d4-4adf-a206-47df1a3e1c66 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:33.654199 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-953b8225-e8d4-4adf-a206-47df1a3e1c66 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:33.654979 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-953b8225-e8d4-4adf-a206-47df1a3e1c66 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:33.655415 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-953b8225-e8d4-4adf-a206-47df1a3e1c66 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:33.789056 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-953b8225-e8d4-4adf-a206-47df1a3e1c66 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5912a78e824903b42eb3a4392688c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e4cf5597804239bfa60665a4aef3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:33.796534 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-953b8225-e8d4-4adf-a206-47df1a3e1c66 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] 10.222.0.64 "GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd" status: 200 len: 1470 microversion: 2.1 time: 0.153875 Aug 03 13:04:33.797099 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 300/573] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:33 2022] GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:04:34.087286 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-2c0fcb07-2bf1-4d43-ad9b-5107c1f2ae8b tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:34.087898 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-2c0fcb07-2bf1-4d43-ad9b-5107c1f2ae8b tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 5079c8f3-b98d-4036-987d-fcac401752ed] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:34.094047 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2c0fcb07-2bf1-4d43-ad9b-5107c1f2ae8b tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:34.094502 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2c0fcb07-2bf1-4d43-ad9b-5107c1f2ae8b tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:34.095308 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2c0fcb07-2bf1-4d43-ad9b-5107c1f2ae8b tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:34.095745 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2c0fcb07-2bf1-4d43-ad9b-5107c1f2ae8b tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:34.156745 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-2c0fcb07-2bf1-4d43-ad9b-5107c1f2ae8b tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:34.164356 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-2c0fcb07-2bf1-4d43-ad9b-5107c1f2ae8b tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed" status: 200 len: 1294 microversion: 2.1 time: 0.081585 Aug 03 13:04:34.164916 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 274/574] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:34 2022] GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed => generated 1294 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:04:34.412814 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-90fdf1b4-9156-4342-82ca-e1d592e9f874 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:34.413433 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-90fdf1b4-9156-4342-82ca-e1d592e9f874 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:34.419542 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-90fdf1b4-9156-4342-82ca-e1d592e9f874 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:34.419972 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-90fdf1b4-9156-4342-82ca-e1d592e9f874 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:34.420718 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-90fdf1b4-9156-4342-82ca-e1d592e9f874 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:34.421151 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-90fdf1b4-9156-4342-82ca-e1d592e9f874 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:34.548783 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-90fdf1b4-9156-4342-82ca-e1d592e9f874 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:34.557468 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-90fdf1b4-9156-4342-82ca-e1d592e9f874 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:34.558988 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-90fdf1b4-9156-4342-82ca-e1d592e9f874 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:34.560153 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-90fdf1b4-9156-4342-82ca-e1d592e9f874 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1724 microversion: 2.20 time: 0.151419 Aug 03 13:04:34.560701 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 301/575] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:04:34 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:04:34.817509 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-ef9b204d-e34f-45c6-9707-b03ee4ef2b5e tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:34.818212 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-ef9b204d-e34f-45c6-9707-b03ee4ef2b5e tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] [instance: 94bd67ea-f25b-40dc-9cb5-8601fef05fcd] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:34.824647 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ef9b204d-e34f-45c6-9707-b03ee4ef2b5e tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:34.825159 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ef9b204d-e34f-45c6-9707-b03ee4ef2b5e tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:34.825998 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ef9b204d-e34f-45c6-9707-b03ee4ef2b5e tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:34.826507 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ef9b204d-e34f-45c6-9707-b03ee4ef2b5e tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:34.966830 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ef9b204d-e34f-45c6-9707-b03ee4ef2b5e tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5912a78e824903b42eb3a4392688c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e4cf5597804239bfa60665a4aef3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:34.974918 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-ef9b204d-e34f-45c6-9707-b03ee4ef2b5e tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] 10.222.0.64 "GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd" status: 200 len: 1470 microversion: 2.1 time: 0.161275 Aug 03 13:04:34.975585 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 275/576] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:34 2022] GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:04:35.185144 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-4bd38eb5-9d14-4cae-bab2-22412ea3f812 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:35.185864 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-4bd38eb5-9d14-4cae-bab2-22412ea3f812 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 5079c8f3-b98d-4036-987d-fcac401752ed] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:35.191983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4bd38eb5-9d14-4cae-bab2-22412ea3f812 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:35.192526 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4bd38eb5-9d14-4cae-bab2-22412ea3f812 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:35.193357 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4bd38eb5-9d14-4cae-bab2-22412ea3f812 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:35.193858 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4bd38eb5-9d14-4cae-bab2-22412ea3f812 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:35.255323 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-4bd38eb5-9d14-4cae-bab2-22412ea3f812 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:35.263613 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-4bd38eb5-9d14-4cae-bab2-22412ea3f812 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed" status: 200 len: 1300 microversion: 2.1 time: 0.082353 Aug 03 13:04:35.264182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 302/577] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:35 2022] GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed => generated 1300 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:04:35.582752 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-8db386a5-9807-43a4-bae8-cc6c725804bb tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:35.583480 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-8db386a5-9807-43a4-bae8-cc6c725804bb tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:35.590349 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8db386a5-9807-43a4-bae8-cc6c725804bb tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:35.590837 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8db386a5-9807-43a4-bae8-cc6c725804bb tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:35.591625 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8db386a5-9807-43a4-bae8-cc6c725804bb tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:35.592066 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8db386a5-9807-43a4-bae8-cc6c725804bb tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:35.610805 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:35.727123 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-8db386a5-9807-43a4-bae8-cc6c725804bb tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:35.735549 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-8db386a5-9807-43a4-bae8-cc6c725804bb tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:35.737047 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-8db386a5-9807-43a4-bae8-cc6c725804bb tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:35.738210 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-8db386a5-9807-43a4-bae8-cc6c725804bb tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1724 microversion: 2.20 time: 0.159478 Aug 03 13:04:35.738777 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 276/578] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:04:35 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:04:35.857048 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-efec0073-be5b-4570-aa4c-d4fab94317e5 req-1e1d7b19-a6a2-4772-a76c-ea685f4d740f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94bd67ea-f25b-40dc-9cb5-8601fef05fcd", "name": "network-vif-deleted", "tag": "84f17796-5680-4ac7-920f-7616db3d1477"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:04:35.868167 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-efec0073-be5b-4570-aa4c-d4fab94317e5 req-1e1d7b19-a6a2-4772-a76c-ea685f4d740f service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:35.868599 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-efec0073-be5b-4570-aa4c-d4fab94317e5 req-1e1d7b19-a6a2-4772-a76c-ea685f4d740f service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:35.881094 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-efec0073-be5b-4570-aa4c-d4fab94317e5 req-1e1d7b19-a6a2-4772-a76c-ea685f4d740f service nova] Creating event network-vif-deleted:84f17796-5680-4ac7-920f-7616db3d1477 for instance 94bd67ea-f25b-40dc-9cb5-8601fef05fcd on hv-cinder-85083 Aug 03 13:04:35.887769 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-efec0073-be5b-4570-aa4c-d4fab94317e5 req-1e1d7b19-a6a2-4772-a76c-ea685f4d740f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034296 Aug 03 13:04:35.888882 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 303/579] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:04:35.996427 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d399ca87-c3e7-4c83-a886-5465d5dc83f1 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:35.997036 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d399ca87-c3e7-4c83-a886-5465d5dc83f1 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] [instance: 94bd67ea-f25b-40dc-9cb5-8601fef05fcd] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:36.004421 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d399ca87-c3e7-4c83-a886-5465d5dc83f1 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:36.004880 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d399ca87-c3e7-4c83-a886-5465d5dc83f1 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:36.005998 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d399ca87-c3e7-4c83-a886-5465d5dc83f1 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:36.006615 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d399ca87-c3e7-4c83-a886-5465d5dc83f1 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:36.076303 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d399ca87-c3e7-4c83-a886-5465d5dc83f1 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5912a78e824903b42eb3a4392688c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e4cf5597804239bfa60665a4aef3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:36.083872 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d399ca87-c3e7-4c83-a886-5465d5dc83f1 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] 10.222.0.64 "GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd" status: 200 len: 1300 microversion: 2.1 time: 0.091434 Aug 03 13:04:36.084612 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 277/580] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:35 2022] GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:04:36.288619 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-276bfa22-675c-4852-8c5c-3f53d9210616 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:36.289718 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-276bfa22-675c-4852-8c5c-3f53d9210616 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 5079c8f3-b98d-4036-987d-fcac401752ed] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:36.296685 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-276bfa22-675c-4852-8c5c-3f53d9210616 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:36.297130 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-276bfa22-675c-4852-8c5c-3f53d9210616 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:36.297892 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-276bfa22-675c-4852-8c5c-3f53d9210616 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:36.298320 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-276bfa22-675c-4852-8c5c-3f53d9210616 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:36.443858 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-276bfa22-675c-4852-8c5c-3f53d9210616 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:36.454662 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-276bfa22-675c-4852-8c5c-3f53d9210616 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed" status: 200 len: 1368 microversion: 2.1 time: 0.170743 Aug 03 13:04:36.455346 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 304/581] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:36 2022] GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:04:36.763625 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-06a437dc-5e53-40fb-8840-8bfbfa3e885d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:36.764232 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-06a437dc-5e53-40fb-8840-8bfbfa3e885d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:36.770205 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-06a437dc-5e53-40fb-8840-8bfbfa3e885d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:36.770653 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-06a437dc-5e53-40fb-8840-8bfbfa3e885d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:36.771440 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-06a437dc-5e53-40fb-8840-8bfbfa3e885d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:36.771885 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-06a437dc-5e53-40fb-8840-8bfbfa3e885d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:36.911935 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-06a437dc-5e53-40fb-8840-8bfbfa3e885d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:36.920173 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-06a437dc-5e53-40fb-8840-8bfbfa3e885d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:36.924854 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-06a437dc-5e53-40fb-8840-8bfbfa3e885d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:36.924854 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-06a437dc-5e53-40fb-8840-8bfbfa3e885d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1724 microversion: 2.20 time: 0.163167 Aug 03 13:04:36.924854 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 278/582] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:04:36 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:04:37.104485 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-7dc9198f-ec76-4818-8f04-99feac1316a9 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:37.108519 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-7dc9198f-ec76-4818-8f04-99feac1316a9 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] [instance: 94bd67ea-f25b-40dc-9cb5-8601fef05fcd] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:37.111523 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7dc9198f-ec76-4818-8f04-99feac1316a9 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:37.111970 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7dc9198f-ec76-4818-8f04-99feac1316a9 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:37.112755 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7dc9198f-ec76-4818-8f04-99feac1316a9 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:37.113234 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7dc9198f-ec76-4818-8f04-99feac1316a9 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:37.126983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-7dc9198f-ec76-4818-8f04-99feac1316a9 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] HTTP exception thrown: Instance 94bd67ea-f25b-40dc-9cb5-8601fef05fcd could not be found. Aug 03 13:04:37.131031 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-7dc9198f-ec76-4818-8f04-99feac1316a9 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Request method failure captured: Aug 03 13:04:37.131031 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd HTTP/1.1 Aug 03 13:04:37.131031 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 13:04:37.131031 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 13:04:37.131031 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 13:04:37.131031 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 0 Aug 03 13:04:37.131031 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 13:04:37.131031 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 13:04:37.131031 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 13:04:37.131031 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 13:04:37.131031 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nJLagpSwtIzweYysm3drySpoQbCO4wTJz_sXpYMlLQNqyl3HjozfvgebAEw2HknQhJ8Yapbcyjb7u4d9JDbEliCXBDzpLJ0q5b466nGyHR-d3_SAGBjgFAt9AXqw9nktqk_3eeqrdlmoAn3Vw7btU3PC4up6A2v3BbydzHbNgXQzMQ Aug 03 13:04:37.131031 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 13:04:37.131031 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 13:04:37.131031 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 13:04:37.131031 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 13:04:37.131031 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 13:04:37.131031 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 13:04:37.131031 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: 13e4cf5597804239bfa60665a4aef3da Aug 03 13:04:37.131031 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-VolumesNegativeTest-1510053928 Aug 03 13:04:37.131031 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 13:04:37.131031 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 13:04:37.133185 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/13e4cf5597804239bfa60665a4aef3da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/13e4cf5597804239bfa60665a4aef3da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/13e4cf5597804239bfa60665a4aef3da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_13e4cf5597804239bfa60665a4aef3da", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:04:37.133185 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-VolumesNegativeTest-1510053928 Aug 03 13:04:37.133185 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: 13e4cf5597804239bfa60665a4aef3da Aug 03 13:04:37.133185 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-VolumesNegativeTest-1510053928 Aug 03 13:04:37.133185 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-VolumesNegativeTest-1510053928-project Aug 03 13:04:37.133185 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 13:04:37.133185 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 13:04:37.133185 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: 9e5912a78e824903b42eb3a4392688c8 Aug 03 13:04:37.133185 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-VolumesNegativeTest-1510053928-project Aug 03 13:04:37.133185 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: > Aug 03 13:04:37.133185 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Instance 94bd67ea-f25b-40dc-9cb5-8601fef05fcd could not be found. Aug 03 13:04:37.133185 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'id': '94bd67ea-f25b-40dc-9cb5-8601fef05fcd'} Aug 03 13:04:37.134113 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:04:37.134113 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:04:37.134113 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:04:37.134113 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:04:37.134113 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:04:37.134113 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:04:37.134113 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:04:37.134113 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:04:37.134113 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:04:37.134113 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:04:37.134113 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94bd67ea-f25b-40dc-9cb5-8601fef05fcd could not be found. Aug 03 13:04:37.134113 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:04:37.134113 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:04:37.134113 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:04:37.134113 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:04:37.134113 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:04:37.134113 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:04:37.134113 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:04:37.134113 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:04:37.134113 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:04:37.135684 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:04:37.135684 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:04:37.135684 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:04:37.135684 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:04:37.135684 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:04:37.135684 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:04:37.135684 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:04:37.135684 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94bd67ea-f25b-40dc-9cb5-8601fef05fcd could not be found. Aug 03 13:04:37.135684 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:04:37.135684 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:04:37.135684 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:04:37.135684 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:04:37.135684 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:04:37.135684 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:04:37.135684 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:04:37.135684 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:04:37.135684 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94bd67ea-f25b-40dc-9cb5-8601fef05fcd could not be found. Aug 03 13:04:37.135684 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:04:37.137034 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-7dc9198f-ec76-4818-8f04-99feac1316a9 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] Returning 404 to user: Instance 94bd67ea-f25b-40dc-9cb5-8601fef05fcd could not be found. {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:04:37.137034 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-7dc9198f-ec76-4818-8f04-99feac1316a9 tempest-VolumesNegativeTest-1510053928 tempest-VolumesNegativeTest-1510053928-project] 10.222.0.64 "GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd" status: 404 len: 111 microversion: 2.1 time: 0.029697 Aug 03 13:04:37.137034 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 305/583] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:37 2022] GET /compute/v2.1/servers/94bd67ea-f25b-40dc-9cb5-8601fef05fcd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:04:37.476948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-439ec001-c9bd-4a0c-821c-80a91fa5d7e0 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:37.483511 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-439ec001-c9bd-4a0c-821c-80a91fa5d7e0 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 5079c8f3-b98d-4036-987d-fcac401752ed] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:37.483511 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=4 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:37.485835 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-439ec001-c9bd-4a0c-821c-80a91fa5d7e0 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:37.486292 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-439ec001-c9bd-4a0c-821c-80a91fa5d7e0 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:37.487164 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-439ec001-c9bd-4a0c-821c-80a91fa5d7e0 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:37.487605 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-439ec001-c9bd-4a0c-821c-80a91fa5d7e0 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:37.659040 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-439ec001-c9bd-4a0c-821c-80a91fa5d7e0 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:37.667232 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-439ec001-c9bd-4a0c-821c-80a91fa5d7e0 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed" status: 200 len: 1368 microversion: 2.1 time: 0.194620 Aug 03 13:04:37.679391 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 279/584] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:37 2022] GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:04:37.904111 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-78593281-87a4-46dc-9f0b-14578f9154ba req-ec5a465c-da6d-4614-b480-aa0b42e4801c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5079c8f3-b98d-4036-987d-fcac401752ed", "tag": "acaaa8da-476e-4704-b8a2-26ab23a62fb0"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:04:37.914321 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-78593281-87a4-46dc-9f0b-14578f9154ba req-ec5a465c-da6d-4614-b480-aa0b42e4801c service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:37.914777 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-78593281-87a4-46dc-9f0b-14578f9154ba req-ec5a465c-da6d-4614-b480-aa0b42e4801c service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:37.925562 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-78593281-87a4-46dc-9f0b-14578f9154ba req-ec5a465c-da6d-4614-b480-aa0b42e4801c service nova] Creating event network-changed:acaaa8da-476e-4704-b8a2-26ab23a62fb0 for instance 5079c8f3-b98d-4036-987d-fcac401752ed on hv-cinder-85083 Aug 03 13:04:37.930479 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-78593281-87a4-46dc-9f0b-14578f9154ba req-ec5a465c-da6d-4614-b480-aa0b42e4801c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030076 Aug 03 13:04:37.931086 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 306/585] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:04:37.945391 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-2f052e48-85d2-41ab-b48b-0aa4eded9fdf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:37.945995 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-2f052e48-85d2-41ab-b48b-0aa4eded9fdf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:37.951992 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2f052e48-85d2-41ab-b48b-0aa4eded9fdf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:37.952441 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2f052e48-85d2-41ab-b48b-0aa4eded9fdf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:37.953197 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2f052e48-85d2-41ab-b48b-0aa4eded9fdf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:37.953627 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2f052e48-85d2-41ab-b48b-0aa4eded9fdf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:38.083723 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-2f052e48-85d2-41ab-b48b-0aa4eded9fdf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:38.092771 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-2f052e48-85d2-41ab-b48b-0aa4eded9fdf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:38.094409 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-2f052e48-85d2-41ab-b48b-0aa4eded9fdf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:38.095520 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-2f052e48-85d2-41ab-b48b-0aa4eded9fdf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1724 microversion: 2.20 time: 0.154052 Aug 03 13:04:38.096073 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 280/586] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:04:37 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:04:38.689497 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-e6af2162-ce39-4be7-90bb-2230cd0dbf70 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:38.690324 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-e6af2162-ce39-4be7-90bb-2230cd0dbf70 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 5079c8f3-b98d-4036-987d-fcac401752ed] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:38.697327 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e6af2162-ce39-4be7-90bb-2230cd0dbf70 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:38.697780 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e6af2162-ce39-4be7-90bb-2230cd0dbf70 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:38.698557 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e6af2162-ce39-4be7-90bb-2230cd0dbf70 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:38.699012 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e6af2162-ce39-4be7-90bb-2230cd0dbf70 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:38.831590 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-e6af2162-ce39-4be7-90bb-2230cd0dbf70 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:38.839228 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-e6af2162-ce39-4be7-90bb-2230cd0dbf70 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed" status: 200 len: 1368 microversion: 2.1 time: 0.154119 Aug 03 13:04:38.839881 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 307/587] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:38 2022] GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:04:39.119549 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-a87f2467-78e0-4ebd-a557-14586b57ea11 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:39.120164 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-a87f2467-78e0-4ebd-a557-14586b57ea11 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:39.126579 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a87f2467-78e0-4ebd-a557-14586b57ea11 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:39.127064 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a87f2467-78e0-4ebd-a557-14586b57ea11 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:39.127823 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a87f2467-78e0-4ebd-a557-14586b57ea11 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:39.128261 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a87f2467-78e0-4ebd-a557-14586b57ea11 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:39.258545 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-a87f2467-78e0-4ebd-a557-14586b57ea11 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:39.266449 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-a87f2467-78e0-4ebd-a557-14586b57ea11 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:39.267981 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-a87f2467-78e0-4ebd-a557-14586b57ea11 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:39.269112 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-a87f2467-78e0-4ebd-a557-14586b57ea11 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1724 microversion: 2.20 time: 0.154216 Aug 03 13:04:39.269716 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 281/588] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:04:39 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:04:39.859846 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-69056053-e348-41c6-bf97-1f5caa144d95 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:39.860444 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-69056053-e348-41c6-bf97-1f5caa144d95 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 5079c8f3-b98d-4036-987d-fcac401752ed] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:39.866480 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-69056053-e348-41c6-bf97-1f5caa144d95 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:39.869961 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-69056053-e348-41c6-bf97-1f5caa144d95 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:39.869961 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-69056053-e348-41c6-bf97-1f5caa144d95 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:39.869961 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-69056053-e348-41c6-bf97-1f5caa144d95 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:40.007647 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-69056053-e348-41c6-bf97-1f5caa144d95 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:40.013591 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-69056053-e348-41c6-bf97-1f5caa144d95 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed" status: 200 len: 1368 microversion: 2.1 time: 0.157547 Aug 03 13:04:40.014152 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 308/589] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:39 2022] GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:04:40.412786 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-ad704015-bd78-4302-9a48-94ac25b119b9 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:40.412786 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-ad704015-bd78-4302-9a48-94ac25b119b9 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:40.417315 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ad704015-bd78-4302-9a48-94ac25b119b9 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:40.417766 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ad704015-bd78-4302-9a48-94ac25b119b9 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:40.418521 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ad704015-bd78-4302-9a48-94ac25b119b9 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:40.418990 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ad704015-bd78-4302-9a48-94ac25b119b9 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:40.557950 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ad704015-bd78-4302-9a48-94ac25b119b9 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:40.566131 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ad704015-bd78-4302-9a48-94ac25b119b9 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:40.567914 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ad704015-bd78-4302-9a48-94ac25b119b9 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:40.569083 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-ad704015-bd78-4302-9a48-94ac25b119b9 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1724 microversion: 2.20 time: 0.281077 Aug 03 13:04:40.569637 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 282/590] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:04:40 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1724 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:04:41.035212 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-6cab7ed0-1226-4655-bd10-06a24ba5e7e4 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:41.035851 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-6cab7ed0-1226-4655-bd10-06a24ba5e7e4 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 5079c8f3-b98d-4036-987d-fcac401752ed] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:41.037797 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell0:SELECT=2 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:41.039222 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell0:SELECT=8 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:41.044035 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6cab7ed0-1226-4655-bd10-06a24ba5e7e4 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:41.044527 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6cab7ed0-1226-4655-bd10-06a24ba5e7e4 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:41.045285 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6cab7ed0-1226-4655-bd10-06a24ba5e7e4 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:41.045719 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6cab7ed0-1226-4655-bd10-06a24ba5e7e4 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:41.199666 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-6cab7ed0-1226-4655-bd10-06a24ba5e7e4 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:41.207287 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-6cab7ed0-1226-4655-bd10-06a24ba5e7e4 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed" status: 200 len: 1368 microversion: 2.1 time: 0.176255 Aug 03 13:04:41.208248 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 309/591] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:41 2022] GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:04:41.592506 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-9fbfa742-ec4c-48bf-86b9-8a086e54a911 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:41.596157 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-9fbfa742-ec4c-48bf-86b9-8a086e54a911 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:41.599945 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9fbfa742-ec4c-48bf-86b9-8a086e54a911 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:41.600466 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9fbfa742-ec4c-48bf-86b9-8a086e54a911 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:41.601363 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9fbfa742-ec4c-48bf-86b9-8a086e54a911 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:41.601862 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9fbfa742-ec4c-48bf-86b9-8a086e54a911 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:41.734745 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-9fbfa742-ec4c-48bf-86b9-8a086e54a911 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:41.743421 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-9fbfa742-ec4c-48bf-86b9-8a086e54a911 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:41.744948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-9fbfa742-ec4c-48bf-86b9-8a086e54a911 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:41.746113 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-9fbfa742-ec4c-48bf-86b9-8a086e54a911 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1724 microversion: 2.20 time: 0.157781 Aug 03 13:04:41.746669 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 283/592] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:04:41 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:04:42.291559 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-037c903b-9005-45ee-bb4c-f6e393a93b3f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:42.292229 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-037c903b-9005-45ee-bb4c-f6e393a93b3f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 5079c8f3-b98d-4036-987d-fcac401752ed] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:42.298468 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-037c903b-9005-45ee-bb4c-f6e393a93b3f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:42.298961 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-037c903b-9005-45ee-bb4c-f6e393a93b3f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:42.299723 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-037c903b-9005-45ee-bb4c-f6e393a93b3f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:42.300161 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-037c903b-9005-45ee-bb4c-f6e393a93b3f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:42.432264 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-037c903b-9005-45ee-bb4c-f6e393a93b3f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:42.439780 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-037c903b-9005-45ee-bb4c-f6e393a93b3f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed" status: 200 len: 1368 microversion: 2.1 time: 0.215195 Aug 03 13:04:42.440330 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 310/593] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:42 2022] GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed => generated 1368 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:04:42.769556 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d800aa3e-eab2-47f7-9e10-1aedf358d3ab tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:42.770087 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d800aa3e-eab2-47f7-9e10-1aedf358d3ab tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:42.777280 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d800aa3e-eab2-47f7-9e10-1aedf358d3ab tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:42.777729 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d800aa3e-eab2-47f7-9e10-1aedf358d3ab tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:42.778484 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d800aa3e-eab2-47f7-9e10-1aedf358d3ab tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:42.778960 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d800aa3e-eab2-47f7-9e10-1aedf358d3ab tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:42.911507 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d800aa3e-eab2-47f7-9e10-1aedf358d3ab tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:42.919868 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d800aa3e-eab2-47f7-9e10-1aedf358d3ab tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:42.921375 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d800aa3e-eab2-47f7-9e10-1aedf358d3ab tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:42.922537 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d800aa3e-eab2-47f7-9e10-1aedf358d3ab tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1724 microversion: 2.20 time: 0.156928 Aug 03 13:04:42.923113 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 284/594] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:04:42 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:04:43.459622 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-07159412-8a0e-4942-9abb-b30ff2a85192 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:43.460277 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-07159412-8a0e-4942-9abb-b30ff2a85192 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 5079c8f3-b98d-4036-987d-fcac401752ed] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:43.466158 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-07159412-8a0e-4942-9abb-b30ff2a85192 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:43.466600 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-07159412-8a0e-4942-9abb-b30ff2a85192 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:43.467399 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-07159412-8a0e-4942-9abb-b30ff2a85192 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:43.467829 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-07159412-8a0e-4942-9abb-b30ff2a85192 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:43.626940 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-07159412-8a0e-4942-9abb-b30ff2a85192 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:43.634458 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-07159412-8a0e-4942-9abb-b30ff2a85192 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed" status: 200 len: 1368 microversion: 2.1 time: 0.178550 Aug 03 13:04:43.635086 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 311/595] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:43 2022] GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:04:43.945602 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-530c9e41-d395-4aa5-88c0-7488046ba002 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:43.946202 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-530c9e41-d395-4aa5-88c0-7488046ba002 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:43.952777 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-530c9e41-d395-4aa5-88c0-7488046ba002 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:43.953222 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-530c9e41-d395-4aa5-88c0-7488046ba002 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:43.953989 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-530c9e41-d395-4aa5-88c0-7488046ba002 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:43.954416 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-530c9e41-d395-4aa5-88c0-7488046ba002 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:44.112832 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-530c9e41-d395-4aa5-88c0-7488046ba002 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:44.126785 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-530c9e41-d395-4aa5-88c0-7488046ba002 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:44.134946 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-530c9e41-d395-4aa5-88c0-7488046ba002 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:44.136355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-530c9e41-d395-4aa5-88c0-7488046ba002 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1724 microversion: 2.20 time: 0.194679 Aug 03 13:04:44.137079 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 285/596] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:04:43 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:04:44.654558 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-5694afad-c3df-41fd-b8f2-5676ad7a64a6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:44.655180 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-5694afad-c3df-41fd-b8f2-5676ad7a64a6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 5079c8f3-b98d-4036-987d-fcac401752ed] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:44.661449 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5694afad-c3df-41fd-b8f2-5676ad7a64a6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:44.661887 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5694afad-c3df-41fd-b8f2-5676ad7a64a6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:44.662626 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5694afad-c3df-41fd-b8f2-5676ad7a64a6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:44.663080 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5694afad-c3df-41fd-b8f2-5676ad7a64a6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:44.788337 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-5694afad-c3df-41fd-b8f2-5676ad7a64a6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:44.795758 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-5694afad-c3df-41fd-b8f2-5676ad7a64a6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed" status: 200 len: 1368 microversion: 2.1 time: 0.145116 Aug 03 13:04:44.796315 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 312/597] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:44 2022] GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed => generated 1368 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:04:45.144068 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-55f0c6d8-1590-4197-a5f9-7622613897f5 req-daaad139-d913-464b-8ba8-6bd973a91fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5079c8f3-b98d-4036-987d-fcac401752ed", "name": "network-vif-plugged", "status": "completed", "tag": "acaaa8da-476e-4704-b8a2-26ab23a62fb0"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:04:45.150224 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:45.155803 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-55f0c6d8-1590-4197-a5f9-7622613897f5 req-daaad139-d913-464b-8ba8-6bd973a91fe5 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:45.156492 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-55f0c6d8-1590-4197-a5f9-7622613897f5 req-daaad139-d913-464b-8ba8-6bd973a91fe5 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:45.160641 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-5513bfa1-9c43-4ca5-98d2-8cfcacc33238 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:45.168215 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-5513bfa1-9c43-4ca5-98d2-8cfcacc33238 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:45.168215 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5513bfa1-9c43-4ca5-98d2-8cfcacc33238 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:45.168215 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5513bfa1-9c43-4ca5-98d2-8cfcacc33238 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:45.168848 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-55f0c6d8-1590-4197-a5f9-7622613897f5 req-daaad139-d913-464b-8ba8-6bd973a91fe5 service nova] Creating event network-vif-plugged:acaaa8da-476e-4704-b8a2-26ab23a62fb0 for instance 5079c8f3-b98d-4036-987d-fcac401752ed on hv-cinder-85083 Aug 03 13:04:45.168982 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5513bfa1-9c43-4ca5-98d2-8cfcacc33238 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:45.169322 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5513bfa1-9c43-4ca5-98d2-8cfcacc33238 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:45.183272 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-55f0c6d8-1590-4197-a5f9-7622613897f5 req-daaad139-d913-464b-8ba8-6bd973a91fe5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042581 Aug 03 13:04:45.183765 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 286/598] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:04:45.315746 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-5513bfa1-9c43-4ca5-98d2-8cfcacc33238 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:45.324186 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-5513bfa1-9c43-4ca5-98d2-8cfcacc33238 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:45.325689 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-5513bfa1-9c43-4ca5-98d2-8cfcacc33238 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:45.326859 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-5513bfa1-9c43-4ca5-98d2-8cfcacc33238 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1745 microversion: 2.20 time: 0.170456 Aug 03 13:04:45.327408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 313/599] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:04:45 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:04:45.817428 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-6d5cd567-b4b8-4bcd-b4d1-8516d6fd695e tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:45.818116 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-6d5cd567-b4b8-4bcd-b4d1-8516d6fd695e tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 5079c8f3-b98d-4036-987d-fcac401752ed] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:45.825347 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6d5cd567-b4b8-4bcd-b4d1-8516d6fd695e tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:45.825798 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6d5cd567-b4b8-4bcd-b4d1-8516d6fd695e tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:45.826554 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6d5cd567-b4b8-4bcd-b4d1-8516d6fd695e tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:45.827023 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6d5cd567-b4b8-4bcd-b4d1-8516d6fd695e tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:45.964726 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-6d5cd567-b4b8-4bcd-b4d1-8516d6fd695e tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:45.972216 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-6d5cd567-b4b8-4bcd-b4d1-8516d6fd695e tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed" status: 200 len: 1368 microversion: 2.1 time: 0.159045 Aug 03 13:04:45.972778 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 287/600] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:45 2022] GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:04:46.350062 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-b53a7214-dbae-4323-8174-38e8441e7d64 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:46.351167 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-b53a7214-dbae-4323-8174-38e8441e7d64 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:46.353029 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:46.357773 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b53a7214-dbae-4323-8174-38e8441e7d64 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:46.358218 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b53a7214-dbae-4323-8174-38e8441e7d64 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:46.359004 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b53a7214-dbae-4323-8174-38e8441e7d64 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:46.359437 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b53a7214-dbae-4323-8174-38e8441e7d64 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:46.488085 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b53a7214-dbae-4323-8174-38e8441e7d64 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:46.496673 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b53a7214-dbae-4323-8174-38e8441e7d64 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:46.504144 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b53a7214-dbae-4323-8174-38e8441e7d64 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:46.504144 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-b53a7214-dbae-4323-8174-38e8441e7d64 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1745 microversion: 2.20 time: 0.153399 Aug 03 13:04:46.504144 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 314/601] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:04:46 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:04:46.993697 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-04da38ff-746a-4c15-b000-f31b75f36442 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:46.994421 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-04da38ff-746a-4c15-b000-f31b75f36442 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 5079c8f3-b98d-4036-987d-fcac401752ed] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:47.001989 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-04da38ff-746a-4c15-b000-f31b75f36442 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:47.002535 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-04da38ff-746a-4c15-b000-f31b75f36442 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:47.003448 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-04da38ff-746a-4c15-b000-f31b75f36442 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:47.004012 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-04da38ff-746a-4c15-b000-f31b75f36442 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:47.139828 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-04da38ff-746a-4c15-b000-f31b75f36442 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:47.147867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-04da38ff-746a-4c15-b000-f31b75f36442 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed" status: 200 len: 1368 microversion: 2.1 time: 0.158240 Aug 03 13:04:47.148713 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 288/602] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:46 2022] GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:04:47.521470 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-a54aa026-38cb-4d6c-91de-7bb20dde234d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:47.522171 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-a54aa026-38cb-4d6c-91de-7bb20dde234d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:47.528587 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a54aa026-38cb-4d6c-91de-7bb20dde234d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:47.529041 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a54aa026-38cb-4d6c-91de-7bb20dde234d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:47.529796 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a54aa026-38cb-4d6c-91de-7bb20dde234d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:47.530229 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a54aa026-38cb-4d6c-91de-7bb20dde234d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:47.661651 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-a54aa026-38cb-4d6c-91de-7bb20dde234d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:47.670403 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-a54aa026-38cb-4d6c-91de-7bb20dde234d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:47.671973 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-a54aa026-38cb-4d6c-91de-7bb20dde234d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:47.673148 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-a54aa026-38cb-4d6c-91de-7bb20dde234d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1745 microversion: 2.20 time: 0.155607 Aug 03 13:04:47.673703 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 315/603] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:04:47 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:04:48.168831 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-da2de89e-b902-41a5-a83c-1131dac3758f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:48.169443 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-da2de89e-b902-41a5-a83c-1131dac3758f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 5079c8f3-b98d-4036-987d-fcac401752ed] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:48.175936 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-da2de89e-b902-41a5-a83c-1131dac3758f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:48.176366 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-da2de89e-b902-41a5-a83c-1131dac3758f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:48.178540 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-da2de89e-b902-41a5-a83c-1131dac3758f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:48.178540 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-da2de89e-b902-41a5-a83c-1131dac3758f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:48.309825 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-da2de89e-b902-41a5-a83c-1131dac3758f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:48.317513 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-da2de89e-b902-41a5-a83c-1131dac3758f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed" status: 200 len: 1558 microversion: 2.1 time: 0.152365 Aug 03 13:04:48.318088 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 289/604] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:04:48 2022] GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:04:48.338680 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-44c968e4-e96f-47ca-9730-563ba036f52a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:48.339200 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-44c968e4-e96f-47ca-9730-563ba036f52a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 5079c8f3-b98d-4036-987d-fcac401752ed] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:48.345136 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-44c968e4-e96f-47ca-9730-563ba036f52a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:48.345584 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-44c968e4-e96f-47ca-9730-563ba036f52a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:48.346343 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-44c968e4-e96f-47ca-9730-563ba036f52a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:48.346804 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-44c968e4-e96f-47ca-9730-563ba036f52a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:48.363033 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:48.426002 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-44c968e4-e96f-47ca-9730-563ba036f52a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091624 Aug 03 13:04:48.426599 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 316/605] 10.222.0.64 () {58 vars in 1275 bytes} [Wed Aug 3 13:04:48 2022] GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:04:48.697078 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-c1f50435-1f32-495e-9d17-c18fb4a59dcf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:48.697711 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-c1f50435-1f32-495e-9d17-c18fb4a59dcf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:48.704351 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c1f50435-1f32-495e-9d17-c18fb4a59dcf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:48.704807 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c1f50435-1f32-495e-9d17-c18fb4a59dcf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:48.705821 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c1f50435-1f32-495e-9d17-c18fb4a59dcf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:48.706193 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c1f50435-1f32-495e-9d17-c18fb4a59dcf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:49.071993 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c1f50435-1f32-495e-9d17-c18fb4a59dcf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:49.080175 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c1f50435-1f32-495e-9d17-c18fb4a59dcf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:49.081840 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c1f50435-1f32-495e-9d17-c18fb4a59dcf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:49.083090 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-c1f50435-1f32-495e-9d17-c18fb4a59dcf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1745 microversion: 2.20 time: 0.390897 Aug 03 13:04:49.083922 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 290/606] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:04:48 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1745 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:04:49.119071 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-d95a6ca5-c70a-42d9-9903-b0a7484b8f57 req-f1d61427-4319-421f-a606-25a394e43773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e92b94-74d5-4161-ab5d-80b10c84bfb1", "name": "network-vif-plugged", "status": "completed", "tag": "0950fa19-287f-4d83-950b-1cb1355203d6"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:04:49.130157 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-d95a6ca5-c70a-42d9-9903-b0a7484b8f57 req-f1d61427-4319-421f-a606-25a394e43773 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:49.131097 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-d95a6ca5-c70a-42d9-9903-b0a7484b8f57 req-f1d61427-4319-421f-a606-25a394e43773 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:49.149112 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-d95a6ca5-c70a-42d9-9903-b0a7484b8f57 req-f1d61427-4319-421f-a606-25a394e43773 service nova] Creating event network-vif-plugged:0950fa19-287f-4d83-950b-1cb1355203d6 for instance 67e92b94-74d5-4161-ab5d-80b10c84bfb1 on hv-cinder-85083 Aug 03 13:04:49.163980 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-d95a6ca5-c70a-42d9-9903-b0a7484b8f57 req-f1d61427-4319-421f-a606-25a394e43773 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049774 Aug 03 13:04:49.165385 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 317/607] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:04:49.741741 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-9fa7a88c-de98-4c83-946c-81b91354e1ac req-8bb43e43-6af8-494d-9a41-5d14e606ff2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5079c8f3-b98d-4036-987d-fcac401752ed", "tag": "acaaa8da-476e-4704-b8a2-26ab23a62fb0"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:04:49.751637 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-9fa7a88c-de98-4c83-946c-81b91354e1ac req-8bb43e43-6af8-494d-9a41-5d14e606ff2b service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:49.752080 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-9fa7a88c-de98-4c83-946c-81b91354e1ac req-8bb43e43-6af8-494d-9a41-5d14e606ff2b service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:49.763666 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-9fa7a88c-de98-4c83-946c-81b91354e1ac req-8bb43e43-6af8-494d-9a41-5d14e606ff2b service nova] Creating event network-changed:acaaa8da-476e-4704-b8a2-26ab23a62fb0 for instance 5079c8f3-b98d-4036-987d-fcac401752ed on hv-cinder-85083 Aug 03 13:04:49.768461 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-9fa7a88c-de98-4c83-946c-81b91354e1ac req-8bb43e43-6af8-494d-9a41-5d14e606ff2b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030321 Aug 03 13:04:49.769419 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 291/608] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:04:50.106037 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-99ef560d-a0a7-48a1-bcfe-f701f61beeb6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:50.107014 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-99ef560d-a0a7-48a1-bcfe-f701f61beeb6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:50.114623 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-99ef560d-a0a7-48a1-bcfe-f701f61beeb6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:50.115167 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-99ef560d-a0a7-48a1-bcfe-f701f61beeb6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:50.116599 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-99ef560d-a0a7-48a1-bcfe-f701f61beeb6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:50.117268 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-99ef560d-a0a7-48a1-bcfe-f701f61beeb6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:50.291697 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-99ef560d-a0a7-48a1-bcfe-f701f61beeb6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:50.300598 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-99ef560d-a0a7-48a1-bcfe-f701f61beeb6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:50.302094 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-99ef560d-a0a7-48a1-bcfe-f701f61beeb6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:50.303378 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-99ef560d-a0a7-48a1-bcfe-f701f61beeb6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1745 microversion: 2.20 time: 0.201793 Aug 03 13:04:50.306775 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 318/609] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:04:50 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1745 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:04:51.327473 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-a65295bb-493b-471d-8179-e8a5a0544591 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:51.328089 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-a65295bb-493b-471d-8179-e8a5a0544591 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:51.334293 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a65295bb-493b-471d-8179-e8a5a0544591 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:51.335413 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a65295bb-493b-471d-8179-e8a5a0544591 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:51.336152 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a65295bb-493b-471d-8179-e8a5a0544591 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:51.336588 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a65295bb-493b-471d-8179-e8a5a0544591 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:51.466049 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-a65295bb-493b-471d-8179-e8a5a0544591 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:51.474173 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-a65295bb-493b-471d-8179-e8a5a0544591 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:51.475705 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-a65295bb-493b-471d-8179-e8a5a0544591 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:51.476894 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-a65295bb-493b-471d-8179-e8a5a0544591 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1745 microversion: 2.20 time: 0.154273 Aug 03 13:04:51.477463 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 292/610] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:04:51 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:04:52.500360 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-51538f60-e9b9-456b-a229-24776ba5b559 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:52.501200 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-51538f60-e9b9-456b-a229-24776ba5b559 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:52.507184 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-51538f60-e9b9-456b-a229-24776ba5b559 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:52.507684 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-51538f60-e9b9-456b-a229-24776ba5b559 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:52.509037 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-51538f60-e9b9-456b-a229-24776ba5b559 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:52.509474 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-51538f60-e9b9-456b-a229-24776ba5b559 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:52.712937 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-51538f60-e9b9-456b-a229-24776ba5b559 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:52.723610 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-51538f60-e9b9-456b-a229-24776ba5b559 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:52.729032 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-51538f60-e9b9-456b-a229-24776ba5b559 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:52.730907 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-51538f60-e9b9-456b-a229-24776ba5b559 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1740 microversion: 2.20 time: 0.235202 Aug 03 13:04:52.731462 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 319/611] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:04:52 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1740 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:04:53.761806 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-adf97640-0ba7-4d65-b068-7a45c70ab326 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:53.762366 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-adf97640-0ba7-4d65-b068-7a45c70ab326 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:53.773792 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-adf97640-0ba7-4d65-b068-7a45c70ab326 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:53.776162 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-adf97640-0ba7-4d65-b068-7a45c70ab326 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:53.779156 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-adf97640-0ba7-4d65-b068-7a45c70ab326 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:53.785534 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-adf97640-0ba7-4d65-b068-7a45c70ab326 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:54.101505 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-adf97640-0ba7-4d65-b068-7a45c70ab326 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:54.119945 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-adf97640-0ba7-4d65-b068-7a45c70ab326 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:54.121903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-adf97640-0ba7-4d65-b068-7a45c70ab326 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:54.124245 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-adf97640-0ba7-4d65-b068-7a45c70ab326 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1740 microversion: 2.20 time: 0.369375 Aug 03 13:04:54.125685 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 293/612] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:04:53 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1740 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:04:55.150236 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-f7a2bd2e-a329-448a-a1da-2baf86895b65 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:55.151493 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-f7a2bd2e-a329-448a-a1da-2baf86895b65 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:55.158685 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f7a2bd2e-a329-448a-a1da-2baf86895b65 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:55.159222 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f7a2bd2e-a329-448a-a1da-2baf86895b65 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:55.160169 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f7a2bd2e-a329-448a-a1da-2baf86895b65 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:55.160601 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f7a2bd2e-a329-448a-a1da-2baf86895b65 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:55.393860 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-f7a2bd2e-a329-448a-a1da-2baf86895b65 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:55.404085 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-f7a2bd2e-a329-448a-a1da-2baf86895b65 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:55.405841 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-f7a2bd2e-a329-448a-a1da-2baf86895b65 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:55.407791 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-f7a2bd2e-a329-448a-a1da-2baf86895b65 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1740 microversion: 2.20 time: 0.261502 Aug 03 13:04:55.408824 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 320/613] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:04:55 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1740 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:04:56.444930 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-4b3248af-f53c-4eec-838f-1ecce2166749 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:56.445996 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-4b3248af-f53c-4eec-838f-1ecce2166749 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:56.455756 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4b3248af-f53c-4eec-838f-1ecce2166749 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:56.456306 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4b3248af-f53c-4eec-838f-1ecce2166749 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:56.457290 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4b3248af-f53c-4eec-838f-1ecce2166749 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:56.457841 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4b3248af-f53c-4eec-838f-1ecce2166749 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:56.490397 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=100 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:56.644831 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-4b3248af-f53c-4eec-838f-1ecce2166749 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:56.656004 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-4b3248af-f53c-4eec-838f-1ecce2166749 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:56.658849 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-4b3248af-f53c-4eec-838f-1ecce2166749 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:56.660362 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-4b3248af-f53c-4eec-838f-1ecce2166749 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1740 microversion: 2.20 time: 0.228913 Aug 03 13:04:56.661755 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 294/614] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:04:56 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1740 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:04:57.693292 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-cef60659-dd72-467f-a628-ad32a2233b6f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:57.699445 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-cef60659-dd72-467f-a628-ad32a2233b6f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:57.708259 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-cef60659-dd72-467f-a628-ad32a2233b6f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:57.708701 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-cef60659-dd72-467f-a628-ad32a2233b6f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:57.709474 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-cef60659-dd72-467f-a628-ad32a2233b6f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:57.709906 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-cef60659-dd72-467f-a628-ad32a2233b6f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:57.917283 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-cef60659-dd72-467f-a628-ad32a2233b6f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:57.927655 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-cef60659-dd72-467f-a628-ad32a2233b6f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:57.929352 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-cef60659-dd72-467f-a628-ad32a2233b6f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:57.931276 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-cef60659-dd72-467f-a628-ad32a2233b6f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1740 microversion: 2.20 time: 0.246594 Aug 03 13:04:57.931928 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 321/615] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:04:57 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1740 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:04:58.953494 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-08dc0790-2a44-47fa-9ecb-f43b50ba8b5c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:04:58.954072 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-08dc0790-2a44-47fa-9ecb-f43b50ba8b5c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:04:58.960387 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-08dc0790-2a44-47fa-9ecb-f43b50ba8b5c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:58.960830 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-08dc0790-2a44-47fa-9ecb-f43b50ba8b5c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:58.962282 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-08dc0790-2a44-47fa-9ecb-f43b50ba8b5c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:04:58.962714 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-08dc0790-2a44-47fa-9ecb-f43b50ba8b5c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:04:59.197597 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-08dc0790-2a44-47fa-9ecb-f43b50ba8b5c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:59.205883 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-08dc0790-2a44-47fa-9ecb-f43b50ba8b5c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:59.207418 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-08dc0790-2a44-47fa-9ecb-f43b50ba8b5c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:04:59.208562 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-08dc0790-2a44-47fa-9ecb-f43b50ba8b5c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1740 microversion: 2.20 time: 0.258977 Aug 03 13:04:59.209820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 295/616] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:04:58 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1740 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:00.232705 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-3144508b-836d-43b0-8a75-6cafda3f1513 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:00.243136 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-3144508b-836d-43b0-8a75-6cafda3f1513 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:00.243136 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3144508b-836d-43b0-8a75-6cafda3f1513 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:00.243136 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3144508b-836d-43b0-8a75-6cafda3f1513 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:00.243136 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3144508b-836d-43b0-8a75-6cafda3f1513 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:00.243499 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3144508b-836d-43b0-8a75-6cafda3f1513 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:00.514458 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-3144508b-836d-43b0-8a75-6cafda3f1513 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:00.528880 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-3144508b-836d-43b0-8a75-6cafda3f1513 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:00.530858 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-3144508b-836d-43b0-8a75-6cafda3f1513 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:00.532791 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-3144508b-836d-43b0-8a75-6cafda3f1513 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1740 microversion: 2.20 time: 0.303872 Aug 03 13:05:00.533832 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 322/617] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:00 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1740 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:01.558966 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-f3749bd0-1e6a-4c04-bf99-705b8d30ea79 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:01.560185 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-f3749bd0-1e6a-4c04-bf99-705b8d30ea79 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:01.567968 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f3749bd0-1e6a-4c04-bf99-705b8d30ea79 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:01.568680 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f3749bd0-1e6a-4c04-bf99-705b8d30ea79 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:01.569632 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f3749bd0-1e6a-4c04-bf99-705b8d30ea79 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:01.570240 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f3749bd0-1e6a-4c04-bf99-705b8d30ea79 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:01.832716 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-f3749bd0-1e6a-4c04-bf99-705b8d30ea79 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:01.841618 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-f3749bd0-1e6a-4c04-bf99-705b8d30ea79 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:01.846058 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-f3749bd0-1e6a-4c04-bf99-705b8d30ea79 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:01.849223 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-f3749bd0-1e6a-4c04-bf99-705b8d30ea79 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1740 microversion: 2.20 time: 0.294353 Aug 03 13:05:01.853335 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 296/618] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:01 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1740 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:02.876599 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ca64f156-6dc1-456d-aa56-96012e32b003 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:02.877972 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-ca64f156-6dc1-456d-aa56-96012e32b003 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:02.886293 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ca64f156-6dc1-456d-aa56-96012e32b003 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:02.888673 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ca64f156-6dc1-456d-aa56-96012e32b003 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:02.890640 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ca64f156-6dc1-456d-aa56-96012e32b003 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:02.891951 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ca64f156-6dc1-456d-aa56-96012e32b003 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:03.417196 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ca64f156-6dc1-456d-aa56-96012e32b003 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:03.427913 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ca64f156-6dc1-456d-aa56-96012e32b003 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:03.429460 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ca64f156-6dc1-456d-aa56-96012e32b003 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:03.431219 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-ca64f156-6dc1-456d-aa56-96012e32b003 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1740 microversion: 2.20 time: 0.559230 Aug 03 13:05:03.432220 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 323/619] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:02 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1740 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:04.456000 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-9d61c1eb-0f41-4b1c-8fb1-0a6bb410e573 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:04.458074 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-9d61c1eb-0f41-4b1c-8fb1-0a6bb410e573 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:04.469490 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9d61c1eb-0f41-4b1c-8fb1-0a6bb410e573 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:04.471307 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9d61c1eb-0f41-4b1c-8fb1-0a6bb410e573 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:04.472343 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9d61c1eb-0f41-4b1c-8fb1-0a6bb410e573 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:04.478128 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9d61c1eb-0f41-4b1c-8fb1-0a6bb410e573 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:04.775896 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-9d61c1eb-0f41-4b1c-8fb1-0a6bb410e573 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:04.786974 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-9d61c1eb-0f41-4b1c-8fb1-0a6bb410e573 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:04.789566 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-9d61c1eb-0f41-4b1c-8fb1-0a6bb410e573 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:04.791370 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-9d61c1eb-0f41-4b1c-8fb1-0a6bb410e573 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1740 microversion: 2.20 time: 0.339223 Aug 03 13:05:04.805862 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 297/620] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:04 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1740 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:05:05.033664 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-9fcd9169-23b9-408d-9feb-095fcced312e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Action: 'create', calling method: .version_select at 0x7fe6d82ff670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-285932187", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrjPjiDCcqo9eQ7ESlnzXFwDWPQX12X2Z7SVExFR1jwnrzgzCbgFlkN56mB/+pQDCGgj8P+b+KFpDyH/zLzI+HLV4cZ2bY743QowrzbxEGKvYKF7DWZO7vLmSf2+O99MA=="}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:05:05.050240 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-9fcd9169-23b9-408d-9feb-095fcced312e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Getting quotas for project 5c182a81a1c64866944f21c4e26725a3. Resources: {'key_pairs'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 13:05:05.054242 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-9fcd9169-23b9-408d-9feb-095fcced312e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Getting quotas for user b2ccafac03aa420db7f76165f20b0d3b and project 5c182a81a1c64866944f21c4e26725a3. Resources: {'key_pairs'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 13:05:05.282139 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-9fcd9169-23b9-408d-9feb-095fcced312e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.476764 Aug 03 13:05:05.282935 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 324/621] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Aug 3 13:05:04 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:05:05.815062 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-0600b2b9-2bc1-4ae5-a3b9-59b457478e75 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:05.815937 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-0600b2b9-2bc1-4ae5-a3b9-59b457478e75 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:05.826728 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0600b2b9-2bc1-4ae5-a3b9-59b457478e75 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:05.828420 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0600b2b9-2bc1-4ae5-a3b9-59b457478e75 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:05.828420 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0600b2b9-2bc1-4ae5-a3b9-59b457478e75 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:05.828679 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0600b2b9-2bc1-4ae5-a3b9-59b457478e75 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:05.989654 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-0600b2b9-2bc1-4ae5-a3b9-59b457478e75 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:05.993805 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-0600b2b9-2bc1-4ae5-a3b9-59b457478e75 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:05.995418 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-0600b2b9-2bc1-4ae5-a3b9-59b457478e75 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:05.996574 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-0600b2b9-2bc1-4ae5-a3b9-59b457478e75 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1740 microversion: 2.20 time: 0.185619 Aug 03 13:05:05.997326 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 298/622] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:05 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:05:07.021538 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-4248905c-70d2-4eda-86b2-bfd7595b6cd7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:07.022276 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-4248905c-70d2-4eda-86b2-bfd7595b6cd7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:07.028666 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4248905c-70d2-4eda-86b2-bfd7595b6cd7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:07.029105 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4248905c-70d2-4eda-86b2-bfd7595b6cd7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:07.029856 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4248905c-70d2-4eda-86b2-bfd7595b6cd7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:07.030281 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4248905c-70d2-4eda-86b2-bfd7595b6cd7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:07.199552 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-4248905c-70d2-4eda-86b2-bfd7595b6cd7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:07.207901 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-4248905c-70d2-4eda-86b2-bfd7595b6cd7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:07.209410 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-4248905c-70d2-4eda-86b2-bfd7595b6cd7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:07.210556 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-4248905c-70d2-4eda-86b2-bfd7595b6cd7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1740 microversion: 2.20 time: 0.193023 Aug 03 13:05:07.211700 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 325/623] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:07 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:08.233999 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-698f8352-9eac-41a2-931b-f43969a184e2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:08.234703 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-698f8352-9eac-41a2-931b-f43969a184e2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:08.243737 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-698f8352-9eac-41a2-931b-f43969a184e2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:08.246247 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-698f8352-9eac-41a2-931b-f43969a184e2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:08.247316 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-698f8352-9eac-41a2-931b-f43969a184e2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:08.249552 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-698f8352-9eac-41a2-931b-f43969a184e2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:08.390955 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-698f8352-9eac-41a2-931b-f43969a184e2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:08.399164 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-698f8352-9eac-41a2-931b-f43969a184e2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:08.400703 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-698f8352-9eac-41a2-931b-f43969a184e2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:08.401857 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-698f8352-9eac-41a2-931b-f43969a184e2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1722 microversion: 2.20 time: 0.171882 Aug 03 13:05:08.402424 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 299/624] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:08 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:09.425301 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-486166ae-31a5-4785-941c-272bc6d0672c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:09.425913 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-486166ae-31a5-4785-941c-272bc6d0672c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:09.432785 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-486166ae-31a5-4785-941c-272bc6d0672c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:09.433233 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-486166ae-31a5-4785-941c-272bc6d0672c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:09.434073 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-486166ae-31a5-4785-941c-272bc6d0672c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:09.434538 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-486166ae-31a5-4785-941c-272bc6d0672c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:09.581421 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-486166ae-31a5-4785-941c-272bc6d0672c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:09.592017 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-486166ae-31a5-4785-941c-272bc6d0672c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:09.593639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-486166ae-31a5-4785-941c-272bc6d0672c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:09.594915 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-486166ae-31a5-4785-941c-272bc6d0672c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1722 microversion: 2.20 time: 0.173489 Aug 03 13:05:09.595564 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 326/625] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:09 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:09.943867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-adcfc62c-34cb-40c9-8d79-c99346617b5e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:05:09.946093 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-adcfc62c-34cb-40c9-8d79-c99346617b5e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:09.952832 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-adcfc62c-34cb-40c9-8d79-c99346617b5e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:09.953283 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-adcfc62c-34cb-40c9-8d79-c99346617b5e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:09.954086 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-adcfc62c-34cb-40c9-8d79-c99346617b5e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:09.954521 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-adcfc62c-34cb-40c9-8d79-c99346617b5e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:10.171631 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-adcfc62c-34cb-40c9-8d79-c99346617b5e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "POST /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a/action" status: 202 len: 0 microversion: 2.1 time: 0.231632 Aug 03 13:05:10.172265 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 300/626] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Aug 3 13:05:09 2022] POST /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 13:05:10.180294 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d065b507-ed11-40f2-a386-5a8a01809834 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:10.180901 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-d065b507-ed11-40f2-a386-5a8a01809834 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:10.187106 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d065b507-ed11-40f2-a386-5a8a01809834 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:10.187548 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d065b507-ed11-40f2-a386-5a8a01809834 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:10.188293 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d065b507-ed11-40f2-a386-5a8a01809834 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:10.188716 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d065b507-ed11-40f2-a386-5a8a01809834 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:10.333631 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-d065b507-ed11-40f2-a386-5a8a01809834 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:10.342059 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-d065b507-ed11-40f2-a386-5a8a01809834 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1753 microversion: 2.1 time: 0.165674 Aug 03 13:05:10.342611 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 327/627] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:10 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:10.617945 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-0ea829c7-6473-46f3-82c8-01e37679730a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:10.618657 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-0ea829c7-6473-46f3-82c8-01e37679730a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:10.625014 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0ea829c7-6473-46f3-82c8-01e37679730a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:10.625466 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0ea829c7-6473-46f3-82c8-01e37679730a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:10.626226 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0ea829c7-6473-46f3-82c8-01e37679730a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:10.626663 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0ea829c7-6473-46f3-82c8-01e37679730a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:10.766075 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-0ea829c7-6473-46f3-82c8-01e37679730a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:10.779419 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-0ea829c7-6473-46f3-82c8-01e37679730a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:10.781432 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-0ea829c7-6473-46f3-82c8-01e37679730a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:10.783026 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-0ea829c7-6473-46f3-82c8-01e37679730a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1722 microversion: 2.20 time: 0.169341 Aug 03 13:05:10.784048 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 301/628] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:10 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:11.363727 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ca872137-aa6d-4a45-80a5-b9055df44cb2 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:11.364442 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-ca872137-aa6d-4a45-80a5-b9055df44cb2 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:11.371448 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ca872137-aa6d-4a45-80a5-b9055df44cb2 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:11.371815 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ca872137-aa6d-4a45-80a5-b9055df44cb2 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:11.372572 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ca872137-aa6d-4a45-80a5-b9055df44cb2 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:11.372995 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ca872137-aa6d-4a45-80a5-b9055df44cb2 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:11.530199 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ca872137-aa6d-4a45-80a5-b9055df44cb2 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:11.538637 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-ca872137-aa6d-4a45-80a5-b9055df44cb2 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1753 microversion: 2.1 time: 0.178961 Aug 03 13:05:11.539240 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 328/629] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:11 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1753 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:11.808297 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-fc18d033-c5b6-4098-8c11-efff19935027 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:11.808945 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-fc18d033-c5b6-4098-8c11-efff19935027 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:11.815509 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fc18d033-c5b6-4098-8c11-efff19935027 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:11.815960 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fc18d033-c5b6-4098-8c11-efff19935027 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:11.816760 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fc18d033-c5b6-4098-8c11-efff19935027 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:11.817195 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fc18d033-c5b6-4098-8c11-efff19935027 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:11.947195 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-fc18d033-c5b6-4098-8c11-efff19935027 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:11.955256 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-fc18d033-c5b6-4098-8c11-efff19935027 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:11.956757 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-fc18d033-c5b6-4098-8c11-efff19935027 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:11.957897 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-fc18d033-c5b6-4098-8c11-efff19935027 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1665 microversion: 2.20 time: 0.154261 Aug 03 13:05:11.958446 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 302/630] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:11 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1665 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:11.980713 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-8b7ac70d-5aa8-4764-8656-b8f1816ef828 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f80487b-d082-419d-aac5-09ca4d6a6d31"}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:05:11.983881 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-8b7ac70d-5aa8-4764-8656-b8f1816ef828 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:11.990323 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8b7ac70d-5aa8-4764-8656-b8f1816ef828 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:11.990794 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8b7ac70d-5aa8-4764-8656-b8f1816ef828 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:11.991570 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8b7ac70d-5aa8-4764-8656-b8f1816ef828 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:11.992006 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8b7ac70d-5aa8-4764-8656-b8f1816ef828 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:12.560208 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-a80d6eec-8e6c-4f2f-aeef-f05ee2801c3e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:12.560818 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-a80d6eec-8e6c-4f2f-aeef-f05ee2801c3e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:12.567439 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a80d6eec-8e6c-4f2f-aeef-f05ee2801c3e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:12.567917 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a80d6eec-8e6c-4f2f-aeef-f05ee2801c3e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:12.569055 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a80d6eec-8e6c-4f2f-aeef-f05ee2801c3e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:12.569525 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a80d6eec-8e6c-4f2f-aeef-f05ee2801c3e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:12.720937 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-a80d6eec-8e6c-4f2f-aeef-f05ee2801c3e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:12.728803 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-a80d6eec-8e6c-4f2f-aeef-f05ee2801c3e tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1758 microversion: 2.1 time: 0.172680 Aug 03 13:05:12.729370 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 303/631] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:12 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:05:12.926620 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-8b7ac70d-5aa8-4764-8656-b8f1816ef828 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "POST /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.950474 Aug 03 13:05:12.927326 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 329/632] 10.222.0.64 () {62 vars in 1364 bytes} [Wed Aug 3 13:05:11 2022] POST /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1/os-volume_attachments => generated 188 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 13:05:13.056536 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-cdb647a9-0493-4818-9707-6f9985eeee4a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:05:13.057689 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-cdb647a9-0493-4818-9707-6f9985eeee4a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:13.064298 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cdb647a9-0493-4818-9707-6f9985eeee4a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:13.064747 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cdb647a9-0493-4818-9707-6f9985eeee4a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:13.065500 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cdb647a9-0493-4818-9707-6f9985eeee4a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:13.065935 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cdb647a9-0493-4818-9707-6f9985eeee4a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:13.210193 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-cdb647a9-0493-4818-9707-6f9985eeee4a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119410) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 03 13:05:13.270607 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-5c296f14-d64d-4fe9-adf0-07363a805f0b req-fa8d1e29-feb8-4842-a438-f334fb6a30bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e92b94-74d5-4161-ab5d-80b10c84bfb1", "name": "network-vif-unplugged", "status": "completed", "tag": "0950fa19-287f-4d83-950b-1cb1355203d6"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:05:13.281409 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-5c296f14-d64d-4fe9-adf0-07363a805f0b req-fa8d1e29-feb8-4842-a438-f334fb6a30bc service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:13.282105 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-5c296f14-d64d-4fe9-adf0-07363a805f0b req-fa8d1e29-feb8-4842-a438-f334fb6a30bc service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:13.292852 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.compute.server_external_events [req-5c296f14-d64d-4fe9-adf0-07363a805f0b req-fa8d1e29-feb8-4842-a438-f334fb6a30bc service nova] Unable to find a host for instance 67e92b94-74d5-4161-ab5d-80b10c84bfb1. Dropping event network-vif-unplugged {{(pid=119409) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 03 13:05:13.297791 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-5c296f14-d64d-4fe9-adf0-07363a805f0b req-fa8d1e29-feb8-4842-a438-f334fb6a30bc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027536 Aug 03 13:05:13.297791 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 330/633] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 03 13:05:13.466625 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-cdb647a9-0493-4818-9707-6f9985eeee4a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "POST /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1/action" status: 202 len: 0 microversion: 2.20 time: 0.413942 Aug 03 13:05:13.467311 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 304/634] 10.222.0.64 () {62 vars in 1319 bytes} [Wed Aug 3 13:05:13 2022] POST /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 13:05:13.475328 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-665dd683-436b-46f0-8452-1f17c24da36a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:13.475935 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-665dd683-436b-46f0-8452-1f17c24da36a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:13.482022 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-665dd683-436b-46f0-8452-1f17c24da36a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:13.482529 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-665dd683-436b-46f0-8452-1f17c24da36a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:13.483408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-665dd683-436b-46f0-8452-1f17c24da36a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:13.483913 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-665dd683-436b-46f0-8452-1f17c24da36a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:13.621542 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-665dd683-436b-46f0-8452-1f17c24da36a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:13.630366 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-665dd683-436b-46f0-8452-1f17c24da36a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:13.632419 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-665dd683-436b-46f0-8452-1f17c24da36a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:13.633661 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-665dd683-436b-46f0-8452-1f17c24da36a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1751 microversion: 2.20 time: 0.162201 Aug 03 13:05:13.634514 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 331/635] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:13 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:13.750992 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-ce216200-122e-4855-b230-52e3cb00f8ef tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:13.751612 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-ce216200-122e-4855-b230-52e3cb00f8ef tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:13.757572 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ce216200-122e-4855-b230-52e3cb00f8ef tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:13.762497 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ce216200-122e-4855-b230-52e3cb00f8ef tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:13.762497 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ce216200-122e-4855-b230-52e3cb00f8ef tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:13.762497 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ce216200-122e-4855-b230-52e3cb00f8ef tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:13.906655 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ce216200-122e-4855-b230-52e3cb00f8ef tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:13.914979 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-ce216200-122e-4855-b230-52e3cb00f8ef tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1758 microversion: 2.1 time: 0.167901 Aug 03 13:05:13.915534 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 305/636] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:13 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:14.657511 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-f58e0ab4-a3f0-4aac-b58d-aba5754c2cdf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:14.658111 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-f58e0ab4-a3f0-4aac-b58d-aba5754c2cdf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:14.664273 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f58e0ab4-a3f0-4aac-b58d-aba5754c2cdf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:14.664707 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f58e0ab4-a3f0-4aac-b58d-aba5754c2cdf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:14.665472 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f58e0ab4-a3f0-4aac-b58d-aba5754c2cdf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:14.665895 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f58e0ab4-a3f0-4aac-b58d-aba5754c2cdf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:14.804436 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-f58e0ab4-a3f0-4aac-b58d-aba5754c2cdf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:14.813509 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-f58e0ab4-a3f0-4aac-b58d-aba5754c2cdf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:14.815308 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-f58e0ab4-a3f0-4aac-b58d-aba5754c2cdf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:14.816814 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-f58e0ab4-a3f0-4aac-b58d-aba5754c2cdf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1751 microversion: 2.20 time: 0.163297 Aug 03 13:05:14.817398 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 332/637] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:14 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:14.937348 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-47b2136d-a072-48cb-88db-abd0de63ca40 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:14.937940 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-47b2136d-a072-48cb-88db-abd0de63ca40 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:14.944565 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-47b2136d-a072-48cb-88db-abd0de63ca40 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:14.945010 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-47b2136d-a072-48cb-88db-abd0de63ca40 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:14.945772 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-47b2136d-a072-48cb-88db-abd0de63ca40 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:14.946205 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-47b2136d-a072-48cb-88db-abd0de63ca40 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:15.094370 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-47b2136d-a072-48cb-88db-abd0de63ca40 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:15.102275 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-47b2136d-a072-48cb-88db-abd0de63ca40 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1758 microversion: 2.1 time: 0.169029 Aug 03 13:05:15.105523 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 306/638] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:14 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:15.842017 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-0b358760-c6c6-4449-858e-3dec1b3315fe tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:15.842634 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-0b358760-c6c6-4449-858e-3dec1b3315fe tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:15.844629 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell0:SELECT=4 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:05:15.849613 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0b358760-c6c6-4449-858e-3dec1b3315fe tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:15.850055 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0b358760-c6c6-4449-858e-3dec1b3315fe tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:15.850854 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0b358760-c6c6-4449-858e-3dec1b3315fe tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:15.851292 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0b358760-c6c6-4449-858e-3dec1b3315fe tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:15.855321 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:05:15.988641 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-0b358760-c6c6-4449-858e-3dec1b3315fe tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:15.997553 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-0b358760-c6c6-4449-858e-3dec1b3315fe tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:15.999066 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-0b358760-c6c6-4449-858e-3dec1b3315fe tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:16.000202 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-0b358760-c6c6-4449-858e-3dec1b3315fe tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1753 microversion: 2.20 time: 0.162695 Aug 03 13:05:16.000755 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 333/639] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:15 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:16.125026 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-ffc9b6ff-0a3c-42fa-b55f-8eefc86151de tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:16.125639 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-ffc9b6ff-0a3c-42fa-b55f-8eefc86151de tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:16.128199 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:05:16.133118 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ffc9b6ff-0a3c-42fa-b55f-8eefc86151de tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:16.133580 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ffc9b6ff-0a3c-42fa-b55f-8eefc86151de tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:16.134383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ffc9b6ff-0a3c-42fa-b55f-8eefc86151de tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:16.134862 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ffc9b6ff-0a3c-42fa-b55f-8eefc86151de tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:16.295786 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ffc9b6ff-0a3c-42fa-b55f-8eefc86151de tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:16.304151 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-ffc9b6ff-0a3c-42fa-b55f-8eefc86151de tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1758 microversion: 2.1 time: 0.183076 Aug 03 13:05:16.308354 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 307/640] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:16 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1758 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:17.025344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-10ab63dd-f2ef-43ab-a06c-14cf7b88d59c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:17.025940 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-10ab63dd-f2ef-43ab-a06c-14cf7b88d59c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:17.032387 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-10ab63dd-f2ef-43ab-a06c-14cf7b88d59c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:17.032838 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-10ab63dd-f2ef-43ab-a06c-14cf7b88d59c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:17.033606 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-10ab63dd-f2ef-43ab-a06c-14cf7b88d59c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:17.034049 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-10ab63dd-f2ef-43ab-a06c-14cf7b88d59c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:17.171817 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-10ab63dd-f2ef-43ab-a06c-14cf7b88d59c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:17.180385 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-10ab63dd-f2ef-43ab-a06c-14cf7b88d59c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:17.182042 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-10ab63dd-f2ef-43ab-a06c-14cf7b88d59c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:17.184130 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-10ab63dd-f2ef-43ab-a06c-14cf7b88d59c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.162801 Aug 03 13:05:17.184957 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 334/641] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:17 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:17.327220 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-324576fc-0d37-4592-a916-41531434829f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:17.327827 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-324576fc-0d37-4592-a916-41531434829f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:17.334206 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-324576fc-0d37-4592-a916-41531434829f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:17.334643 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-324576fc-0d37-4592-a916-41531434829f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:17.335433 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-324576fc-0d37-4592-a916-41531434829f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:17.335958 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-324576fc-0d37-4592-a916-41531434829f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:17.486749 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-324576fc-0d37-4592-a916-41531434829f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:17.494835 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-324576fc-0d37-4592-a916-41531434829f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1758 microversion: 2.1 time: 0.171438 Aug 03 13:05:17.496227 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 308/642] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:17 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:18.215249 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-9969fc6b-9192-4cab-83af-4e43aa17d0b8 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:18.215870 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-9969fc6b-9192-4cab-83af-4e43aa17d0b8 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:18.217699 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:05:18.225070 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9969fc6b-9192-4cab-83af-4e43aa17d0b8 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:18.225582 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9969fc6b-9192-4cab-83af-4e43aa17d0b8 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:18.226339 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9969fc6b-9192-4cab-83af-4e43aa17d0b8 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:18.226784 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9969fc6b-9192-4cab-83af-4e43aa17d0b8 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:18.359687 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-9969fc6b-9192-4cab-83af-4e43aa17d0b8 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:18.368000 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-9969fc6b-9192-4cab-83af-4e43aa17d0b8 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:18.369477 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-9969fc6b-9192-4cab-83af-4e43aa17d0b8 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:18.371165 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-9969fc6b-9192-4cab-83af-4e43aa17d0b8 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.163292 Aug 03 13:05:18.371715 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 335/643] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:18 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:18.517202 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-a7fda73e-2f24-44a7-ab5e-7ec84c8d6768 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:18.517830 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-a7fda73e-2f24-44a7-ab5e-7ec84c8d6768 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:18.524554 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a7fda73e-2f24-44a7-ab5e-7ec84c8d6768 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:18.528632 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a7fda73e-2f24-44a7-ab5e-7ec84c8d6768 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:18.528632 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a7fda73e-2f24-44a7-ab5e-7ec84c8d6768 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:18.528632 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a7fda73e-2f24-44a7-ab5e-7ec84c8d6768 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:18.532593 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:05:18.685586 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-a7fda73e-2f24-44a7-ab5e-7ec84c8d6768 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:18.693940 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-a7fda73e-2f24-44a7-ab5e-7ec84c8d6768 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1758 microversion: 2.1 time: 0.180673 Aug 03 13:05:18.694608 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 309/644] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:18 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:18.738182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-2fe2d3a6-26d0-43d6-8e6d-21cd1bc671a7 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "797f90c8-0ac4-44d2-b116-4ac961ee4cf9"}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:05:18.740825 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-2fe2d3a6-26d0-43d6-8e6d-21cd1bc671a7 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:18.749162 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2fe2d3a6-26d0-43d6-8e6d-21cd1bc671a7 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:18.749985 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2fe2d3a6-26d0-43d6-8e6d-21cd1bc671a7 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:18.751066 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2fe2d3a6-26d0-43d6-8e6d-21cd1bc671a7 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:18.751725 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2fe2d3a6-26d0-43d6-8e6d-21cd1bc671a7 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:19.396448 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d1c99a2f-4ddf-468f-85fd-119b78a96127 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:19.396975 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d1c99a2f-4ddf-468f-85fd-119b78a96127 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:19.403718 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d1c99a2f-4ddf-468f-85fd-119b78a96127 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:19.404169 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d1c99a2f-4ddf-468f-85fd-119b78a96127 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:19.404988 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d1c99a2f-4ddf-468f-85fd-119b78a96127 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:19.405375 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d1c99a2f-4ddf-468f-85fd-119b78a96127 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:19.566781 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d1c99a2f-4ddf-468f-85fd-119b78a96127 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:19.576195 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d1c99a2f-4ddf-468f-85fd-119b78a96127 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:19.578105 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d1c99a2f-4ddf-468f-85fd-119b78a96127 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:19.579997 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d1c99a2f-4ddf-468f-85fd-119b78a96127 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.187547 Aug 03 13:05:19.594523 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 310/645] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:19 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:05:19.716851 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-52c613f5-2363-48fc-8d0b-9ed4bc16d690 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:19.717595 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-52c613f5-2363-48fc-8d0b-9ed4bc16d690 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:19.723962 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-52c613f5-2363-48fc-8d0b-9ed4bc16d690 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:19.724403 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-52c613f5-2363-48fc-8d0b-9ed4bc16d690 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:19.725221 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-52c613f5-2363-48fc-8d0b-9ed4bc16d690 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:19.725650 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-52c613f5-2363-48fc-8d0b-9ed4bc16d690 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:19.881683 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-52c613f5-2363-48fc-8d0b-9ed4bc16d690 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:19.892607 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-52c613f5-2363-48fc-8d0b-9ed4bc16d690 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1758 microversion: 2.1 time: 0.180567 Aug 03 13:05:19.893191 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 311/646] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:19 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:05:20.603872 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-0ffa5208-2470-4e03-b999-1ec542a06f35 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:20.605036 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-0ffa5208-2470-4e03-b999-1ec542a06f35 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:20.611824 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0ffa5208-2470-4e03-b999-1ec542a06f35 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:20.612277 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0ffa5208-2470-4e03-b999-1ec542a06f35 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:20.613038 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0ffa5208-2470-4e03-b999-1ec542a06f35 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:20.613475 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0ffa5208-2470-4e03-b999-1ec542a06f35 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:20.763743 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-0ffa5208-2470-4e03-b999-1ec542a06f35 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:20.773878 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-0ffa5208-2470-4e03-b999-1ec542a06f35 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:20.775427 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-0ffa5208-2470-4e03-b999-1ec542a06f35 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:20.777132 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-0ffa5208-2470-4e03-b999-1ec542a06f35 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.177368 Aug 03 13:05:20.777690 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 312/647] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:20 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:05:20.917384 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-96b2f594-6308-4ed5-af2c-0e0bbc4ad382 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:20.918379 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-96b2f594-6308-4ed5-af2c-0e0bbc4ad382 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:20.925808 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-96b2f594-6308-4ed5-af2c-0e0bbc4ad382 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:20.926263 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-96b2f594-6308-4ed5-af2c-0e0bbc4ad382 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:20.927072 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-96b2f594-6308-4ed5-af2c-0e0bbc4ad382 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:20.927518 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-96b2f594-6308-4ed5-af2c-0e0bbc4ad382 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:21.079649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-96b2f594-6308-4ed5-af2c-0e0bbc4ad382 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:21.087780 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-96b2f594-6308-4ed5-af2c-0e0bbc4ad382 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1758 microversion: 2.1 time: 0.176597 Aug 03 13:05:21.088352 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 313/648] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:20 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:05:21.801424 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1689c842-b332-4b8f-94d1-e90a2448b322 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:21.802101 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-1689c842-b332-4b8f-94d1-e90a2448b322 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:21.809181 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1689c842-b332-4b8f-94d1-e90a2448b322 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:21.809576 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1689c842-b332-4b8f-94d1-e90a2448b322 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:21.810329 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1689c842-b332-4b8f-94d1-e90a2448b322 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:21.810782 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1689c842-b332-4b8f-94d1-e90a2448b322 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:21.959409 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-1689c842-b332-4b8f-94d1-e90a2448b322 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:21.967821 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-1689c842-b332-4b8f-94d1-e90a2448b322 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:21.969424 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-1689c842-b332-4b8f-94d1-e90a2448b322 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:21.971148 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-1689c842-b332-4b8f-94d1-e90a2448b322 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.173367 Aug 03 13:05:21.971902 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 314/649] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:21 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:05:22.110363 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-2fc7bc5e-2004-4f71-916d-2729826c6453 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:22.111010 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-2fc7bc5e-2004-4f71-916d-2729826c6453 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:22.119295 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2fc7bc5e-2004-4f71-916d-2729826c6453 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:22.119784 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2fc7bc5e-2004-4f71-916d-2729826c6453 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:22.120616 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2fc7bc5e-2004-4f71-916d-2729826c6453 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:22.121047 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2fc7bc5e-2004-4f71-916d-2729826c6453 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:22.271774 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-2fc7bc5e-2004-4f71-916d-2729826c6453 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:22.281807 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-2fc7bc5e-2004-4f71-916d-2729826c6453 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1758 microversion: 2.1 time: 0.175871 Aug 03 13:05:22.282639 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 315/650] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:22 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:05:22.997850 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1dac8e7c-7215-4cd2-baca-be2bb3438e6a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:22.998531 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-1dac8e7c-7215-4cd2-baca-be2bb3438e6a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:23.005153 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1dac8e7c-7215-4cd2-baca-be2bb3438e6a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:23.005602 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1dac8e7c-7215-4cd2-baca-be2bb3438e6a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:23.006370 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1dac8e7c-7215-4cd2-baca-be2bb3438e6a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:23.006840 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1dac8e7c-7215-4cd2-baca-be2bb3438e6a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:23.147377 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-1dac8e7c-7215-4cd2-baca-be2bb3438e6a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:23.156109 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-1dac8e7c-7215-4cd2-baca-be2bb3438e6a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:23.157868 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-1dac8e7c-7215-4cd2-baca-be2bb3438e6a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:23.159065 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-1dac8e7c-7215-4cd2-baca-be2bb3438e6a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.165840 Aug 03 13:05:23.159647 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 316/651] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:22 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:23.304772 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-bee6e158-33ec-475e-8e19-298316d2c126 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:23.305351 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-bee6e158-33ec-475e-8e19-298316d2c126 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:23.312150 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bee6e158-33ec-475e-8e19-298316d2c126 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:23.312600 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bee6e158-33ec-475e-8e19-298316d2c126 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:23.313358 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bee6e158-33ec-475e-8e19-298316d2c126 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:23.313793 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bee6e158-33ec-475e-8e19-298316d2c126 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:23.460157 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-bee6e158-33ec-475e-8e19-298316d2c126 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:23.468388 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-bee6e158-33ec-475e-8e19-298316d2c126 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1758 microversion: 2.1 time: 0.167576 Aug 03 13:05:23.469006 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 317/652] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:23 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:05:24.181385 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-9284e46b-34f4-4021-b1bc-68ed65d539a8 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:24.181983 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-9284e46b-34f4-4021-b1bc-68ed65d539a8 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:24.188455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9284e46b-34f4-4021-b1bc-68ed65d539a8 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:24.188890 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9284e46b-34f4-4021-b1bc-68ed65d539a8 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:24.189631 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9284e46b-34f4-4021-b1bc-68ed65d539a8 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:24.190060 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9284e46b-34f4-4021-b1bc-68ed65d539a8 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:24.352559 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-9284e46b-34f4-4021-b1bc-68ed65d539a8 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:24.360997 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-9284e46b-34f4-4021-b1bc-68ed65d539a8 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:24.362508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-9284e46b-34f4-4021-b1bc-68ed65d539a8 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:24.363894 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-9284e46b-34f4-4021-b1bc-68ed65d539a8 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.186391 Aug 03 13:05:24.364452 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 318/653] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:24 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:05:24.490857 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-8f99a82d-c38a-4ebd-9c90-1de7f1f4125c tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:24.491523 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-8f99a82d-c38a-4ebd-9c90-1de7f1f4125c tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:24.498100 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8f99a82d-c38a-4ebd-9c90-1de7f1f4125c tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:24.498552 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8f99a82d-c38a-4ebd-9c90-1de7f1f4125c tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:24.499344 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8f99a82d-c38a-4ebd-9c90-1de7f1f4125c tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:24.499783 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8f99a82d-c38a-4ebd-9c90-1de7f1f4125c tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:24.647233 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-8f99a82d-c38a-4ebd-9c90-1de7f1f4125c tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:24.655196 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-8f99a82d-c38a-4ebd-9c90-1de7f1f4125c tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1758 microversion: 2.1 time: 0.168246 Aug 03 13:05:24.655767 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 319/654] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:24 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:05:25.387665 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-abb44a37-1b44-4381-82ba-e9a8603704a3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:25.388311 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-abb44a37-1b44-4381-82ba-e9a8603704a3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:25.395109 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-abb44a37-1b44-4381-82ba-e9a8603704a3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:25.395561 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-abb44a37-1b44-4381-82ba-e9a8603704a3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:25.396333 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-abb44a37-1b44-4381-82ba-e9a8603704a3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:25.396770 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-abb44a37-1b44-4381-82ba-e9a8603704a3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:25.533764 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-abb44a37-1b44-4381-82ba-e9a8603704a3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:25.542274 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-abb44a37-1b44-4381-82ba-e9a8603704a3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:25.543800 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-abb44a37-1b44-4381-82ba-e9a8603704a3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:25.544952 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-abb44a37-1b44-4381-82ba-e9a8603704a3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.161667 Aug 03 13:05:25.545559 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 320/655] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:25 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:05:25.677056 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-0c2730d1-a5af-45fa-8fb0-ca14e365e48a tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:25.677670 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-0c2730d1-a5af-45fa-8fb0-ca14e365e48a tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:25.683762 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0c2730d1-a5af-45fa-8fb0-ca14e365e48a tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:25.684214 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0c2730d1-a5af-45fa-8fb0-ca14e365e48a tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:25.684973 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0c2730d1-a5af-45fa-8fb0-ca14e365e48a tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:25.685407 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0c2730d1-a5af-45fa-8fb0-ca14e365e48a tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:25.834256 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-0c2730d1-a5af-45fa-8fb0-ca14e365e48a tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:25.842205 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-0c2730d1-a5af-45fa-8fb0-ca14e365e48a tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1758 microversion: 2.1 time: 0.168982 Aug 03 13:05:25.842813 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 321/656] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:25 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:05:26.567686 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-36fd0276-9f50-45a0-b46f-a8a362ae06af tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:26.568415 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-36fd0276-9f50-45a0-b46f-a8a362ae06af tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:26.575116 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-36fd0276-9f50-45a0-b46f-a8a362ae06af tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:26.575579 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-36fd0276-9f50-45a0-b46f-a8a362ae06af tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:26.576332 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-36fd0276-9f50-45a0-b46f-a8a362ae06af tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:26.576764 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-36fd0276-9f50-45a0-b46f-a8a362ae06af tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:26.724185 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-36fd0276-9f50-45a0-b46f-a8a362ae06af tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:26.734832 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-36fd0276-9f50-45a0-b46f-a8a362ae06af tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:26.736692 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-36fd0276-9f50-45a0-b46f-a8a362ae06af tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:26.738347 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-36fd0276-9f50-45a0-b46f-a8a362ae06af tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.174746 Aug 03 13:05:26.739617 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 322/657] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:26 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:05:26.864460 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-a2498761-8e0b-48cc-846e-66d39378fe11 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:26.865109 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-a2498761-8e0b-48cc-846e-66d39378fe11 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:26.871349 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a2498761-8e0b-48cc-846e-66d39378fe11 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:26.871799 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a2498761-8e0b-48cc-846e-66d39378fe11 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:26.872559 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a2498761-8e0b-48cc-846e-66d39378fe11 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:26.872986 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a2498761-8e0b-48cc-846e-66d39378fe11 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:27.034777 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-a2498761-8e0b-48cc-846e-66d39378fe11 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:27.042708 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-a2498761-8e0b-48cc-846e-66d39378fe11 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1758 microversion: 2.1 time: 0.182126 Aug 03 13:05:27.043300 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 323/658] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:26 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:05:27.761413 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-5f80e112-933e-40a6-968e-306a804bb6dc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:27.762121 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-5f80e112-933e-40a6-968e-306a804bb6dc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:27.768475 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5f80e112-933e-40a6-968e-306a804bb6dc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:27.768926 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5f80e112-933e-40a6-968e-306a804bb6dc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:27.769679 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5f80e112-933e-40a6-968e-306a804bb6dc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:27.770115 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5f80e112-933e-40a6-968e-306a804bb6dc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:27.906830 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-5f80e112-933e-40a6-968e-306a804bb6dc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:27.915570 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-5f80e112-933e-40a6-968e-306a804bb6dc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:27.917593 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-5f80e112-933e-40a6-968e-306a804bb6dc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:27.918766 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-5f80e112-933e-40a6-968e-306a804bb6dc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.161299 Aug 03 13:05:27.919312 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 324/659] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:27 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:05:28.063781 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-f052676f-3446-4f81-b2fe-24db66660f04 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:28.064307 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-f052676f-3446-4f81-b2fe-24db66660f04 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:28.070281 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f052676f-3446-4f81-b2fe-24db66660f04 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:28.070750 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f052676f-3446-4f81-b2fe-24db66660f04 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:28.071514 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f052676f-3446-4f81-b2fe-24db66660f04 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:28.071947 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f052676f-3446-4f81-b2fe-24db66660f04 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:28.234435 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-f052676f-3446-4f81-b2fe-24db66660f04 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:28.238435 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=100 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:05:28.242991 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-f052676f-3446-4f81-b2fe-24db66660f04 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1758 microversion: 2.1 time: 0.183110 Aug 03 13:05:28.243601 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 325/660] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:28 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1758 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:05:28.749917 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=3 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:05:28.870478 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=22 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:05:28.941686 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-160551fa-536a-4616-adb4-3404b6bbf117 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:28.942359 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-160551fa-536a-4616-adb4-3404b6bbf117 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:28.950198 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-160551fa-536a-4616-adb4-3404b6bbf117 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:28.950705 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-160551fa-536a-4616-adb4-3404b6bbf117 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:28.951510 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-160551fa-536a-4616-adb4-3404b6bbf117 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:28.951952 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-160551fa-536a-4616-adb4-3404b6bbf117 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:29.110788 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-160551fa-536a-4616-adb4-3404b6bbf117 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:29.122086 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-160551fa-536a-4616-adb4-3404b6bbf117 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:29.124575 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-160551fa-536a-4616-adb4-3404b6bbf117 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:29.125859 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-160551fa-536a-4616-adb4-3404b6bbf117 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.188472 Aug 03 13:05:29.126861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 326/661] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:28 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:05:29.265259 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-3fb9674f-dc8e-4b82-9892-f7a8234b6038 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:29.265878 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-3fb9674f-dc8e-4b82-9892-f7a8234b6038 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:29.272424 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3fb9674f-dc8e-4b82-9892-f7a8234b6038 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:29.272879 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3fb9674f-dc8e-4b82-9892-f7a8234b6038 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:29.273656 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3fb9674f-dc8e-4b82-9892-f7a8234b6038 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:29.274095 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3fb9674f-dc8e-4b82-9892-f7a8234b6038 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:29.434762 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-3fb9674f-dc8e-4b82-9892-f7a8234b6038 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:29.443038 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-3fb9674f-dc8e-4b82-9892-f7a8234b6038 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1758 microversion: 2.1 time: 0.181624 Aug 03 13:05:29.443604 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 327/662] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:29 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:05:30.158209 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-2f849e55-d18b-481c-85b0-56910d9d041f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:30.162771 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-2f849e55-d18b-481c-85b0-56910d9d041f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:30.169757 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2f849e55-d18b-481c-85b0-56910d9d041f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:30.170154 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2f849e55-d18b-481c-85b0-56910d9d041f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:30.170967 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2f849e55-d18b-481c-85b0-56910d9d041f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:30.171409 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2f849e55-d18b-481c-85b0-56910d9d041f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:30.311482 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-2f849e55-d18b-481c-85b0-56910d9d041f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:30.319915 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-2f849e55-d18b-481c-85b0-56910d9d041f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:30.321428 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-2f849e55-d18b-481c-85b0-56910d9d041f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:30.322572 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-2f849e55-d18b-481c-85b0-56910d9d041f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.168563 Aug 03 13:05:30.323183 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 328/663] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:30 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:30.465247 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-0c0d4474-ecbb-40ab-a656-167d950b25cb tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:30.465846 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-0c0d4474-ecbb-40ab-a656-167d950b25cb tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:30.471989 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0c0d4474-ecbb-40ab-a656-167d950b25cb tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:30.472459 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0c0d4474-ecbb-40ab-a656-167d950b25cb tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:30.473283 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0c0d4474-ecbb-40ab-a656-167d950b25cb tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:30.473712 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0c0d4474-ecbb-40ab-a656-167d950b25cb tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:30.616460 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-0c0d4474-ecbb-40ab-a656-167d950b25cb tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:30.624387 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-0c0d4474-ecbb-40ab-a656-167d950b25cb tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1758 microversion: 2.1 time: 0.163485 Aug 03 13:05:30.624953 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 329/664] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:30 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:05:31.345522 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-2c3304f6-3ada-4d9b-ab94-04d54d8d8fb0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:31.346174 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-2c3304f6-3ada-4d9b-ab94-04d54d8d8fb0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:31.352649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2c3304f6-3ada-4d9b-ab94-04d54d8d8fb0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:31.353102 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2c3304f6-3ada-4d9b-ab94-04d54d8d8fb0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:31.353862 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2c3304f6-3ada-4d9b-ab94-04d54d8d8fb0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:31.354300 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2c3304f6-3ada-4d9b-ab94-04d54d8d8fb0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:31.484700 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-2c3304f6-3ada-4d9b-ab94-04d54d8d8fb0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:31.493080 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-2c3304f6-3ada-4d9b-ab94-04d54d8d8fb0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:31.494575 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-2c3304f6-3ada-4d9b-ab94-04d54d8d8fb0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:31.496344 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-2c3304f6-3ada-4d9b-ab94-04d54d8d8fb0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.154818 Aug 03 13:05:31.496912 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 330/665] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:31 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:05:31.645942 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-f78cbf22-2ce3-4dfd-be9c-e15f71e0e19d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:31.646511 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-f78cbf22-2ce3-4dfd-be9c-e15f71e0e19d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:31.652533 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f78cbf22-2ce3-4dfd-be9c-e15f71e0e19d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:31.652983 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f78cbf22-2ce3-4dfd-be9c-e15f71e0e19d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:31.653743 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f78cbf22-2ce3-4dfd-be9c-e15f71e0e19d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:31.654176 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f78cbf22-2ce3-4dfd-be9c-e15f71e0e19d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:31.792349 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-f78cbf22-2ce3-4dfd-be9c-e15f71e0e19d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:31.800228 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-f78cbf22-2ce3-4dfd-be9c-e15f71e0e19d tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1758 microversion: 2.1 time: 0.158138 Aug 03 13:05:31.800799 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 331/666] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:31 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1758 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:05:32.519264 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-b87f42b9-39ea-4326-9b16-ef4399620f55 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:32.519916 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-b87f42b9-39ea-4326-9b16-ef4399620f55 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:32.526576 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b87f42b9-39ea-4326-9b16-ef4399620f55 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:32.527056 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b87f42b9-39ea-4326-9b16-ef4399620f55 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:32.527818 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b87f42b9-39ea-4326-9b16-ef4399620f55 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:32.528254 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b87f42b9-39ea-4326-9b16-ef4399620f55 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:32.668424 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-b87f42b9-39ea-4326-9b16-ef4399620f55 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:32.676770 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-b87f42b9-39ea-4326-9b16-ef4399620f55 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:32.678265 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-b87f42b9-39ea-4326-9b16-ef4399620f55 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:32.679458 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-b87f42b9-39ea-4326-9b16-ef4399620f55 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.164048 Aug 03 13:05:32.680021 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 332/667] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:32 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:05:32.821103 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-2a7d9e89-63df-40be-aa91-ef8184ea88af tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:32.821713 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-2a7d9e89-63df-40be-aa91-ef8184ea88af tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:32.828233 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2a7d9e89-63df-40be-aa91-ef8184ea88af tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:32.828685 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2a7d9e89-63df-40be-aa91-ef8184ea88af tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:32.829451 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2a7d9e89-63df-40be-aa91-ef8184ea88af tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:32.829890 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2a7d9e89-63df-40be-aa91-ef8184ea88af tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:32.973296 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-2a7d9e89-63df-40be-aa91-ef8184ea88af tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:32.981860 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-2a7d9e89-63df-40be-aa91-ef8184ea88af tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1758 microversion: 2.1 time: 0.164464 Aug 03 13:05:32.982435 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 333/668] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:32 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:05:33.702745 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-deb45fd9-2115-459c-a24a-ff7acc1afd58 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:33.703362 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-deb45fd9-2115-459c-a24a-ff7acc1afd58 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:33.709999 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-deb45fd9-2115-459c-a24a-ff7acc1afd58 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:33.710465 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-deb45fd9-2115-459c-a24a-ff7acc1afd58 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:33.711262 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-deb45fd9-2115-459c-a24a-ff7acc1afd58 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:33.711689 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-deb45fd9-2115-459c-a24a-ff7acc1afd58 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:33.842005 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-deb45fd9-2115-459c-a24a-ff7acc1afd58 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:33.850366 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-deb45fd9-2115-459c-a24a-ff7acc1afd58 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:33.851872 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-deb45fd9-2115-459c-a24a-ff7acc1afd58 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:33.853011 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-deb45fd9-2115-459c-a24a-ff7acc1afd58 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.154204 Aug 03 13:05:33.853589 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 334/669] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:33 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:34.003770 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-50c5ecb9-a38f-407e-94b4-90bd2aa47128 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:34.004367 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-50c5ecb9-a38f-407e-94b4-90bd2aa47128 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:34.010345 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-50c5ecb9-a38f-407e-94b4-90bd2aa47128 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:34.010826 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-50c5ecb9-a38f-407e-94b4-90bd2aa47128 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:34.011572 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-50c5ecb9-a38f-407e-94b4-90bd2aa47128 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:34.011998 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-50c5ecb9-a38f-407e-94b4-90bd2aa47128 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:34.111337 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-2fe2d3a6-26d0-43d6-8e6d-21cd1bc671a7 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "POST /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 15.496471 Aug 03 13:05:34.111965 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 336/670] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Aug 3 13:05:18 2022] POST /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14/os-volume_attachments => generated 194 bytes in 15498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:05:34.163992 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-50c5ecb9-a38f-407e-94b4-90bd2aa47128 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:34.172762 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-50c5ecb9-a38f-407e-94b4-90bd2aa47128 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1758 microversion: 2.1 time: 0.172857 Aug 03 13:05:34.173416 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 335/671] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:33 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:05:34.335161 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d2a912a7-ba7e-4832-99a9-3ce3a246d4a5 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-415774288", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-285932187", "security_groups": [{"name": "tempest-secgroup-smoke-1269265979"}], "block_device_mapping_v2": [{"uuid": "157199c7-a923-4769-8b05-f111c6cbfe77", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "31f3d8b1-aaa3-4a1b-acac-10a82d58c4cb"}]}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:05:34.450688 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.network.neutron [None req-d2a912a7-ba7e-4832-99a9-3ce3a246d4a5 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] validate_networks() for [('31f3d8b1-aaa3-4a1b-acac-10a82d58c4cb', None, None, None, None, None)] {{(pid=119409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 13:05:34.870879 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-d2a912a7-ba7e-4832-99a9-3ce3a246d4a5 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Flavor limits 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 13:05:34.871741 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-d2a912a7-ba7e-4832-99a9-3ce3a246d4a5 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Image limits 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 13:05:34.872349 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-d2a912a7-ba7e-4832-99a9-3ce3a246d4a5 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Flavor pref 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 13:05:34.872889 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-d2a912a7-ba7e-4832-99a9-3ce3a246d4a5 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Image pref 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 13:05:34.873454 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-d2a912a7-ba7e-4832-99a9-3ce3a246d4a5 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 13:05:34.876579 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-98c30b00-e8a1-4eaa-8c63-b472b21bc6d0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:34.877183 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-98c30b00-e8a1-4eaa-8c63-b472b21bc6d0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:34.883461 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d2a912a7-ba7e-4832-99a9-3ce3a246d4a5 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:34.883630 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-98c30b00-e8a1-4eaa-8c63-b472b21bc6d0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:34.883900 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d2a912a7-ba7e-4832-99a9-3ce3a246d4a5 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:34.884038 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-98c30b00-e8a1-4eaa-8c63-b472b21bc6d0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:34.884686 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d2a912a7-ba7e-4832-99a9-3ce3a246d4a5 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:34.884798 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-98c30b00-e8a1-4eaa-8c63-b472b21bc6d0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:34.885128 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d2a912a7-ba7e-4832-99a9-3ce3a246d4a5 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:34.885277 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-98c30b00-e8a1-4eaa-8c63-b472b21bc6d0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:34.905331 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-d2a912a7-ba7e-4832-99a9-3ce3a246d4a5 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Getting quotas for project 5c182a81a1c64866944f21c4e26725a3. Resources: {'instances', 'ram', 'cores'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 13:05:34.910053 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-d2a912a7-ba7e-4832-99a9-3ce3a246d4a5 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Getting quotas for user b2ccafac03aa420db7f76165f20b0d3b and project 5c182a81a1c64866944f21c4e26725a3. Resources: {'instances', 'ram', 'cores'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 13:05:34.986009 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-d2a912a7-ba7e-4832-99a9-3ce3a246d4a5 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Going to run 1 instances... {{(pid=119409) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 13:05:34.988356 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-d2a912a7-ba7e-4832-99a9-3ce3a246d4a5 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='157199c7-a923-4769-8b05-f111c6cbfe77',volume_size=None,volume_type=None)] {{(pid=119409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 13:05:35.028117 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-98c30b00-e8a1-4eaa-8c63-b472b21bc6d0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:35.036783 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-98c30b00-e8a1-4eaa-8c63-b472b21bc6d0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:35.038312 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-98c30b00-e8a1-4eaa-8c63-b472b21bc6d0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:35.039600 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-98c30b00-e8a1-4eaa-8c63-b472b21bc6d0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.166799 Aug 03 13:05:35.044804 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 336/672] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:34 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:05:35.195347 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-526ad043-d11c-494d-8cae-86c2ae49ebda tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:35.195958 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-526ad043-d11c-494d-8cae-86c2ae49ebda tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:35.202368 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-526ad043-d11c-494d-8cae-86c2ae49ebda tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:35.202844 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-526ad043-d11c-494d-8cae-86c2ae49ebda tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:35.203627 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-526ad043-d11c-494d-8cae-86c2ae49ebda tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:35.204058 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-526ad043-d11c-494d-8cae-86c2ae49ebda tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:35.357649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-526ad043-d11c-494d-8cae-86c2ae49ebda tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:35.365690 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-526ad043-d11c-494d-8cae-86c2ae49ebda tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1758 microversion: 2.1 time: 0.174143 Aug 03 13:05:35.366257 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 337/673] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:35 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:05:35.838860 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-d2a912a7-ba7e-4832-99a9-3ce3a246d4a5 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.501433 Aug 03 13:05:35.840104 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 337/674] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 3 13:05:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 1510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 13:05:35.858051 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-8254a5fa-834d-4fb4-833f-62594c9f846c tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:35.860337 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-8254a5fa-834d-4fb4-833f-62594c9f846c tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:35.920405 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-8254a5fa-834d-4fb4-833f-62594c9f846c tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:35.927220 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-8254a5fa-834d-4fb4-833f-62594c9f846c tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1093 microversion: 2.1 time: 0.080539 Aug 03 13:05:35.928042 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 338/675] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:35 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1093 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:05:36.062951 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d12dca69-25d2-4723-95b2-064d82364f71 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:36.063585 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-d12dca69-25d2-4723-95b2-064d82364f71 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:36.070504 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d12dca69-25d2-4723-95b2-064d82364f71 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:36.070983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d12dca69-25d2-4723-95b2-064d82364f71 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:36.071741 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d12dca69-25d2-4723-95b2-064d82364f71 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:36.072180 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d12dca69-25d2-4723-95b2-064d82364f71 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:36.205529 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-d12dca69-25d2-4723-95b2-064d82364f71 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:36.216893 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-d12dca69-25d2-4723-95b2-064d82364f71 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:36.218332 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-d12dca69-25d2-4723-95b2-064d82364f71 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:36.219632 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-d12dca69-25d2-4723-95b2-064d82364f71 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.160790 Aug 03 13:05:36.220182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 338/676] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:36 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:36.388010 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-4fb0dfd2-a768-4810-9047-a99ccddfeb6c tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:36.388663 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-4fb0dfd2-a768-4810-9047-a99ccddfeb6c tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:36.396777 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4fb0dfd2-a768-4810-9047-a99ccddfeb6c tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:36.397235 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4fb0dfd2-a768-4810-9047-a99ccddfeb6c tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:36.398011 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4fb0dfd2-a768-4810-9047-a99ccddfeb6c tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:36.398619 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4fb0dfd2-a768-4810-9047-a99ccddfeb6c tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:36.544601 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-4fb0dfd2-a768-4810-9047-a99ccddfeb6c tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:36.552730 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-4fb0dfd2-a768-4810-9047-a99ccddfeb6c tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1761 microversion: 2.1 time: 0.169120 Aug 03 13:05:36.553286 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 339/677] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:36 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1761 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:36.947882 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ab4db2d2-357d-4631-980a-c992fdb04e5e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:36.948493 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-ab4db2d2-357d-4631-980a-c992fdb04e5e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:36.955071 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ab4db2d2-357d-4631-980a-c992fdb04e5e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:36.955526 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ab4db2d2-357d-4631-980a-c992fdb04e5e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:36.956285 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ab4db2d2-357d-4631-980a-c992fdb04e5e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:36.956721 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ab4db2d2-357d-4631-980a-c992fdb04e5e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:37.017355 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ab4db2d2-357d-4631-980a-c992fdb04e5e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:37.024668 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-ab4db2d2-357d-4631-980a-c992fdb04e5e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1143 microversion: 2.1 time: 0.080607 Aug 03 13:05:37.025227 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 339/678] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:36 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1143 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:37.242240 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d442619d-20a5-432f-acca-87178685f33c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:37.242883 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d442619d-20a5-432f-acca-87178685f33c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:37.249464 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d442619d-20a5-432f-acca-87178685f33c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:37.249914 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d442619d-20a5-432f-acca-87178685f33c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:37.250672 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d442619d-20a5-432f-acca-87178685f33c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:37.251134 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d442619d-20a5-432f-acca-87178685f33c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:37.383416 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d442619d-20a5-432f-acca-87178685f33c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:37.392254 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d442619d-20a5-432f-acca-87178685f33c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:37.393743 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d442619d-20a5-432f-acca-87178685f33c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:37.394921 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d442619d-20a5-432f-acca-87178685f33c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.156651 Aug 03 13:05:37.395484 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 340/679] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:37 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:38.045633 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-33d10b24-5ec7-47bd-9504-5baa22826321 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:38.046236 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-33d10b24-5ec7-47bd-9504-5baa22826321 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:38.052657 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-33d10b24-5ec7-47bd-9504-5baa22826321 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:38.053098 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-33d10b24-5ec7-47bd-9504-5baa22826321 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:38.053842 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-33d10b24-5ec7-47bd-9504-5baa22826321 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:38.054266 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-33d10b24-5ec7-47bd-9504-5baa22826321 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:38.115107 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-33d10b24-5ec7-47bd-9504-5baa22826321 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:38.122878 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-33d10b24-5ec7-47bd-9504-5baa22826321 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1135 microversion: 2.1 time: 0.081027 Aug 03 13:05:38.123446 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 340/680] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:38 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1135 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:38.418915 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-8048dda3-94ac-4436-baf0-02359743b393 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:38.419528 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-8048dda3-94ac-4436-baf0-02359743b393 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:38.428877 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8048dda3-94ac-4436-baf0-02359743b393 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:38.429333 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8048dda3-94ac-4436-baf0-02359743b393 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:38.430103 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8048dda3-94ac-4436-baf0-02359743b393 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:38.430565 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8048dda3-94ac-4436-baf0-02359743b393 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:38.565178 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-8048dda3-94ac-4436-baf0-02359743b393 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:38.573668 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-8048dda3-94ac-4436-baf0-02359743b393 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:38.575173 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-8048dda3-94ac-4436-baf0-02359743b393 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:38.576310 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-8048dda3-94ac-4436-baf0-02359743b393 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.161752 Aug 03 13:05:38.580303 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 341/681] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:38 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:05:39.144407 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-6494694f-99e3-45ba-99c9-14606f3f8710 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:39.144932 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-6494694f-99e3-45ba-99c9-14606f3f8710 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:39.152204 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6494694f-99e3-45ba-99c9-14606f3f8710 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:39.152535 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6494694f-99e3-45ba-99c9-14606f3f8710 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:39.153288 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6494694f-99e3-45ba-99c9-14606f3f8710 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:39.153711 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6494694f-99e3-45ba-99c9-14606f3f8710 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:39.214187 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-6494694f-99e3-45ba-99c9-14606f3f8710 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:39.221406 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-6494694f-99e3-45ba-99c9-14606f3f8710 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1199 microversion: 2.1 time: 0.080966 Aug 03 13:05:39.221959 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 341/682] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:39 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1199 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:39.549689 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-5ef648b8-57ae-4577-beaf-a1b81c1949c4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:05:39.551632 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-5ef648b8-57ae-4577-beaf-a1b81c1949c4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:39.559278 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5ef648b8-57ae-4577-beaf-a1b81c1949c4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:39.559278 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5ef648b8-57ae-4577-beaf-a1b81c1949c4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:39.560078 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5ef648b8-57ae-4577-beaf-a1b81c1949c4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:39.560433 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5ef648b8-57ae-4577-beaf-a1b81c1949c4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:39.583764 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-5ef648b8-57ae-4577-beaf-a1b81c1949c4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lazy-loading 'flavor' on Instance uuid 76bb2b00-bafa-4b66-98f4-882ae210fe14 {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:05:39.599818 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-3d24c67a-4bbe-4221-8c21-08ce3d9c91a6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:39.600747 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-3d24c67a-4bbe-4221-8c21-08ce3d9c91a6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:39.606546 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3d24c67a-4bbe-4221-8c21-08ce3d9c91a6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:39.607147 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3d24c67a-4bbe-4221-8c21-08ce3d9c91a6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:39.607936 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3d24c67a-4bbe-4221-8c21-08ce3d9c91a6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:39.608265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3d24c67a-4bbe-4221-8c21-08ce3d9c91a6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:39.665607 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:05:39.752105 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-3d24c67a-4bbe-4221-8c21-08ce3d9c91a6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:39.761576 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-3d24c67a-4bbe-4221-8c21-08ce3d9c91a6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:39.763093 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-3d24c67a-4bbe-4221-8c21-08ce3d9c91a6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:39.764238 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-3d24c67a-4bbe-4221-8c21-08ce3d9c91a6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.168576 Aug 03 13:05:39.764794 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 342/683] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:39 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:05:39.883117 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-5ef648b8-57ae-4577-beaf-a1b81c1949c4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "POST /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14/action" status: 200 len: 32 microversion: 2.1 time: 0.337547 Aug 03 13:05:39.884008 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 342/684] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Aug 3 13:05:39 2022] POST /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14/action => generated 32 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 13:05:39.893696 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-20df0a47-e365-40d6-b6c8-28f22d621de5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:39.894329 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-20df0a47-e365-40d6-b6c8-28f22d621de5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:39.900743 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-20df0a47-e365-40d6-b6c8-28f22d621de5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:39.901194 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-20df0a47-e365-40d6-b6c8-28f22d621de5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:39.901954 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-20df0a47-e365-40d6-b6c8-28f22d621de5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:39.902382 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-20df0a47-e365-40d6-b6c8-28f22d621de5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:40.045270 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-20df0a47-e365-40d6-b6c8-28f22d621de5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:40.053487 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-20df0a47-e365-40d6-b6c8-28f22d621de5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1734 microversion: 2.1 time: 0.163693 Aug 03 13:05:40.054227 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 343/685] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:39 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:40.242017 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-3aa1c1c8-5574-46c6-aa25-57cda7e57819 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:40.243045 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-3aa1c1c8-5574-46c6-aa25-57cda7e57819 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:40.250105 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3aa1c1c8-5574-46c6-aa25-57cda7e57819 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:40.250559 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3aa1c1c8-5574-46c6-aa25-57cda7e57819 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:40.251368 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3aa1c1c8-5574-46c6-aa25-57cda7e57819 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:40.251803 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3aa1c1c8-5574-46c6-aa25-57cda7e57819 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:40.394753 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-3aa1c1c8-5574-46c6-aa25-57cda7e57819 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:40.402358 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-3aa1c1c8-5574-46c6-aa25-57cda7e57819 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1277 microversion: 2.1 time: 0.164579 Aug 03 13:05:40.402962 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 343/686] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:40 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:40.787942 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-832ab702-2531-4cbe-9940-aba95591d14f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:40.788686 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-832ab702-2531-4cbe-9940-aba95591d14f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:40.795422 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-832ab702-2531-4cbe-9940-aba95591d14f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:40.795876 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-832ab702-2531-4cbe-9940-aba95591d14f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:40.796644 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-832ab702-2531-4cbe-9940-aba95591d14f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:40.797245 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-832ab702-2531-4cbe-9940-aba95591d14f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:40.938857 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-832ab702-2531-4cbe-9940-aba95591d14f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:40.949007 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-832ab702-2531-4cbe-9940-aba95591d14f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:40.950903 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-832ab702-2531-4cbe-9940-aba95591d14f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:40.952109 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-832ab702-2531-4cbe-9940-aba95591d14f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.168325 Aug 03 13:05:40.952670 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 344/687] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:40 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:41.075507 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-c9ee1e67-6895-46d2-9f75-a9946c8018bd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:41.076110 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-c9ee1e67-6895-46d2-9f75-a9946c8018bd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:41.082628 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c9ee1e67-6895-46d2-9f75-a9946c8018bd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:41.083178 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c9ee1e67-6895-46d2-9f75-a9946c8018bd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:41.083954 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c9ee1e67-6895-46d2-9f75-a9946c8018bd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:41.084397 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c9ee1e67-6895-46d2-9f75-a9946c8018bd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:41.217988 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c9ee1e67-6895-46d2-9f75-a9946c8018bd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:41.225948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-c9ee1e67-6895-46d2-9f75-a9946c8018bd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1734 microversion: 2.1 time: 0.155003 Aug 03 13:05:41.226528 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 344/688] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:41 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:41.425611 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-7217502f-e677-49db-b417-04ee8ddca5ad tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:41.426319 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-7217502f-e677-49db-b417-04ee8ddca5ad tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:41.433032 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7217502f-e677-49db-b417-04ee8ddca5ad tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:41.433487 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7217502f-e677-49db-b417-04ee8ddca5ad tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:41.434250 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7217502f-e677-49db-b417-04ee8ddca5ad tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:41.434686 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7217502f-e677-49db-b417-04ee8ddca5ad tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:41.569183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-7217502f-e677-49db-b417-04ee8ddca5ad tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:41.578933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-7217502f-e677-49db-b417-04ee8ddca5ad tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1277 microversion: 2.1 time: 0.157226 Aug 03 13:05:41.592034 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 345/689] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:41 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:41.633330 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-354d597c-8c95-40ed-853c-e8c99bc560d9 req-a059fea0-c7d0-439a-81c5-c1a7a03f4652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9d598c3-1b65-4871-b23f-ffb42f3551aa", "tag": "7d6c0cd1-c2da-4bd5-9c58-1f68951fec25"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:05:41.643230 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-354d597c-8c95-40ed-853c-e8c99bc560d9 req-a059fea0-c7d0-439a-81c5-c1a7a03f4652 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:41.643668 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-354d597c-8c95-40ed-853c-e8c99bc560d9 req-a059fea0-c7d0-439a-81c5-c1a7a03f4652 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:41.654033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-354d597c-8c95-40ed-853c-e8c99bc560d9 req-a059fea0-c7d0-439a-81c5-c1a7a03f4652 service nova] Creating event network-changed:7d6c0cd1-c2da-4bd5-9c58-1f68951fec25 for instance b9d598c3-1b65-4871-b23f-ffb42f3551aa on hv-cinder-85083 Aug 03 13:05:41.658881 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-354d597c-8c95-40ed-853c-e8c99bc560d9 req-a059fea0-c7d0-439a-81c5-c1a7a03f4652 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103156 Aug 03 13:05:41.659447 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 345/690] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:05:41.975697 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-c9b5b8be-38c9-466e-bafb-355e9177be58 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:41.976305 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-c9b5b8be-38c9-466e-bafb-355e9177be58 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:41.983297 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c9b5b8be-38c9-466e-bafb-355e9177be58 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:41.983741 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c9b5b8be-38c9-466e-bafb-355e9177be58 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:41.984495 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c9b5b8be-38c9-466e-bafb-355e9177be58 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:41.984927 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c9b5b8be-38c9-466e-bafb-355e9177be58 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:42.116174 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-c9b5b8be-38c9-466e-bafb-355e9177be58 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:42.125002 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-c9b5b8be-38c9-466e-bafb-355e9177be58 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:42.126516 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-c9b5b8be-38c9-466e-bafb-355e9177be58 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:42.127680 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-c9b5b8be-38c9-466e-bafb-355e9177be58 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.155894 Aug 03 13:05:42.128259 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 346/691] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:41 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:42.249206 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-3e20cfda-9ec9-4f15-b5e2-8a8f98bd55da tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:42.249873 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-3e20cfda-9ec9-4f15-b5e2-8a8f98bd55da tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:42.256102 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3e20cfda-9ec9-4f15-b5e2-8a8f98bd55da tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:42.256558 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3e20cfda-9ec9-4f15-b5e2-8a8f98bd55da tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:42.257320 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3e20cfda-9ec9-4f15-b5e2-8a8f98bd55da tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:42.257761 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3e20cfda-9ec9-4f15-b5e2-8a8f98bd55da tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:42.390585 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-3e20cfda-9ec9-4f15-b5e2-8a8f98bd55da tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:42.398593 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-3e20cfda-9ec9-4f15-b5e2-8a8f98bd55da tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1734 microversion: 2.1 time: 0.154610 Aug 03 13:05:42.399174 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 346/692] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:42 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:42.599876 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-894b1ed5-5734-475b-a2b6-f85b87c28d0f tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:42.600587 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-894b1ed5-5734-475b-a2b6-f85b87c28d0f tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:42.606909 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-894b1ed5-5734-475b-a2b6-f85b87c28d0f tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:42.607355 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-894b1ed5-5734-475b-a2b6-f85b87c28d0f tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:42.608113 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-894b1ed5-5734-475b-a2b6-f85b87c28d0f tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:42.608539 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-894b1ed5-5734-475b-a2b6-f85b87c28d0f tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:42.742502 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-894b1ed5-5734-475b-a2b6-f85b87c28d0f tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:42.750540 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-894b1ed5-5734-475b-a2b6-f85b87c28d0f tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1277 microversion: 2.1 time: 0.154712 Aug 03 13:05:42.751140 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 347/693] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:42 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:43.151509 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-ef544672-7a33-449f-869c-74415bb148b7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:43.152125 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-ef544672-7a33-449f-869c-74415bb148b7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:43.159801 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ef544672-7a33-449f-869c-74415bb148b7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:43.160327 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ef544672-7a33-449f-869c-74415bb148b7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:43.161030 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ef544672-7a33-449f-869c-74415bb148b7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:43.161465 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ef544672-7a33-449f-869c-74415bb148b7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:43.297650 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ef544672-7a33-449f-869c-74415bb148b7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:43.306161 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ef544672-7a33-449f-869c-74415bb148b7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:43.307681 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ef544672-7a33-449f-869c-74415bb148b7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:43.308839 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-ef544672-7a33-449f-869c-74415bb148b7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.161814 Aug 03 13:05:43.309398 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 347/694] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:43 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:43.420036 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-c51df5e9-27c8-4c52-ab9f-bc7bd0864d32 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:43.420652 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-c51df5e9-27c8-4c52-ab9f-bc7bd0864d32 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:43.427311 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c51df5e9-27c8-4c52-ab9f-bc7bd0864d32 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:43.433842 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c51df5e9-27c8-4c52-ab9f-bc7bd0864d32 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:43.433842 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c51df5e9-27c8-4c52-ab9f-bc7bd0864d32 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:43.433842 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c51df5e9-27c8-4c52-ab9f-bc7bd0864d32 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:43.559519 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-c51df5e9-27c8-4c52-ab9f-bc7bd0864d32 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:43.567451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-c51df5e9-27c8-4c52-ab9f-bc7bd0864d32 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1734 microversion: 2.1 time: 0.151223 Aug 03 13:05:43.568010 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 348/695] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:43 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:43.771734 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-56971f17-2c1a-4176-b7c5-082e8d7c11c4 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:43.772277 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-56971f17-2c1a-4176-b7c5-082e8d7c11c4 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:43.778273 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-56971f17-2c1a-4176-b7c5-082e8d7c11c4 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:43.778714 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-56971f17-2c1a-4176-b7c5-082e8d7c11c4 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:43.779490 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-56971f17-2c1a-4176-b7c5-082e8d7c11c4 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:43.779908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-56971f17-2c1a-4176-b7c5-082e8d7c11c4 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:43.905895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-56971f17-2c1a-4176-b7c5-082e8d7c11c4 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:43.913556 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-56971f17-2c1a-4176-b7c5-082e8d7c11c4 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1265 microversion: 2.1 time: 0.145766 Aug 03 13:05:43.914120 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 348/696] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:43 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:44.331602 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-b87c69b5-6a70-4586-8faa-75b59ad6cc16 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:44.332211 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-b87c69b5-6a70-4586-8faa-75b59ad6cc16 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:44.339929 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b87c69b5-6a70-4586-8faa-75b59ad6cc16 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:44.339929 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b87c69b5-6a70-4586-8faa-75b59ad6cc16 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:44.339929 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b87c69b5-6a70-4586-8faa-75b59ad6cc16 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:44.339929 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b87c69b5-6a70-4586-8faa-75b59ad6cc16 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:44.472187 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b87c69b5-6a70-4586-8faa-75b59ad6cc16 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:44.481113 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b87c69b5-6a70-4586-8faa-75b59ad6cc16 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:44.482611 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b87c69b5-6a70-4586-8faa-75b59ad6cc16 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:44.483881 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-b87c69b5-6a70-4586-8faa-75b59ad6cc16 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.156176 Aug 03 13:05:44.484439 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 349/697] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:44 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:44.589332 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-f9c42220-db8c-4e10-92f7-5cc880457d0e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:44.589936 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-f9c42220-db8c-4e10-92f7-5cc880457d0e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:44.596446 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f9c42220-db8c-4e10-92f7-5cc880457d0e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:44.596891 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f9c42220-db8c-4e10-92f7-5cc880457d0e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:44.597638 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f9c42220-db8c-4e10-92f7-5cc880457d0e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:44.598064 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f9c42220-db8c-4e10-92f7-5cc880457d0e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:44.731902 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-f9c42220-db8c-4e10-92f7-5cc880457d0e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:44.739832 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-f9c42220-db8c-4e10-92f7-5cc880457d0e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1734 microversion: 2.1 time: 0.154875 Aug 03 13:05:44.740394 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 349/698] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:44 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:44.934239 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-444ad3b8-151d-472b-965d-5d0c8ad84e31 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:44.934807 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-444ad3b8-151d-472b-965d-5d0c8ad84e31 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:44.936757 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell0:SELECT=2 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:05:44.937566 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell0:SELECT=6 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:05:44.942208 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-444ad3b8-151d-472b-965d-5d0c8ad84e31 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:44.942658 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-444ad3b8-151d-472b-965d-5d0c8ad84e31 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:44.943446 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-444ad3b8-151d-472b-965d-5d0c8ad84e31 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:44.943880 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-444ad3b8-151d-472b-965d-5d0c8ad84e31 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:45.078387 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-444ad3b8-151d-472b-965d-5d0c8ad84e31 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:45.085734 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-444ad3b8-151d-472b-965d-5d0c8ad84e31 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1265 microversion: 2.1 time: 0.155349 Aug 03 13:05:45.086286 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 350/699] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:44 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:45.506628 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-4011413d-6e89-4bb4-9b40-00ddbe8dd503 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:45.507201 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-4011413d-6e89-4bb4-9b40-00ddbe8dd503 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:45.514024 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4011413d-6e89-4bb4-9b40-00ddbe8dd503 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:45.514476 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4011413d-6e89-4bb4-9b40-00ddbe8dd503 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:45.515303 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4011413d-6e89-4bb4-9b40-00ddbe8dd503 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:45.515750 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4011413d-6e89-4bb4-9b40-00ddbe8dd503 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:45.648294 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-4011413d-6e89-4bb4-9b40-00ddbe8dd503 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:45.653378 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-4011413d-6e89-4bb4-9b40-00ddbe8dd503 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:45.654855 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-4011413d-6e89-4bb4-9b40-00ddbe8dd503 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:45.655989 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-4011413d-6e89-4bb4-9b40-00ddbe8dd503 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.153342 Aug 03 13:05:45.656546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 350/700] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:45 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:45.759929 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-4e5c1458-2be2-4acd-98d1-57218a58b24c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:45.760461 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-4e5c1458-2be2-4acd-98d1-57218a58b24c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:45.766864 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4e5c1458-2be2-4acd-98d1-57218a58b24c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:45.767303 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4e5c1458-2be2-4acd-98d1-57218a58b24c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:45.768046 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4e5c1458-2be2-4acd-98d1-57218a58b24c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:45.768478 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4e5c1458-2be2-4acd-98d1-57218a58b24c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:45.894443 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-4e5c1458-2be2-4acd-98d1-57218a58b24c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:45.902633 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-4e5c1458-2be2-4acd-98d1-57218a58b24c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1734 microversion: 2.1 time: 0.146688 Aug 03 13:05:45.903231 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 351/701] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:45 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:46.107712 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-b78264f1-11e7-4756-8660-7f348a5afd3d tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:46.108322 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-b78264f1-11e7-4756-8660-7f348a5afd3d tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:46.110285 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=2 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:05:46.115144 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b78264f1-11e7-4756-8660-7f348a5afd3d tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:46.115599 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b78264f1-11e7-4756-8660-7f348a5afd3d tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:46.116357 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b78264f1-11e7-4756-8660-7f348a5afd3d tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:46.116791 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b78264f1-11e7-4756-8660-7f348a5afd3d tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:46.250317 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-b78264f1-11e7-4756-8660-7f348a5afd3d tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:46.257728 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-b78264f1-11e7-4756-8660-7f348a5afd3d tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1265 microversion: 2.1 time: 0.154565 Aug 03 13:05:46.258285 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 351/702] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:46 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:46.679373 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-f4d470f9-eba3-4d0e-8904-5af402611c8c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:46.679980 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-f4d470f9-eba3-4d0e-8904-5af402611c8c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:46.685983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f4d470f9-eba3-4d0e-8904-5af402611c8c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:46.686431 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f4d470f9-eba3-4d0e-8904-5af402611c8c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:46.687229 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f4d470f9-eba3-4d0e-8904-5af402611c8c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:46.687666 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f4d470f9-eba3-4d0e-8904-5af402611c8c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:46.817762 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-f4d470f9-eba3-4d0e-8904-5af402611c8c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:46.821117 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:05:46.833074 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-f4d470f9-eba3-4d0e-8904-5af402611c8c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:46.833074 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-f4d470f9-eba3-4d0e-8904-5af402611c8c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:46.833074 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-f4d470f9-eba3-4d0e-8904-5af402611c8c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.154276 Aug 03 13:05:46.833412 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 352/703] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:46 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:46.924559 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-eb1992d8-a61f-4956-b9ad-9bec278470fb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:46.925174 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-eb1992d8-a61f-4956-b9ad-9bec278470fb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:46.927501 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=92 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:05:46.932814 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-eb1992d8-a61f-4956-b9ad-9bec278470fb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:46.933264 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-eb1992d8-a61f-4956-b9ad-9bec278470fb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:46.934029 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-eb1992d8-a61f-4956-b9ad-9bec278470fb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:46.934466 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-eb1992d8-a61f-4956-b9ad-9bec278470fb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:47.064777 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-eb1992d8-a61f-4956-b9ad-9bec278470fb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:47.073446 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-eb1992d8-a61f-4956-b9ad-9bec278470fb tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1734 microversion: 2.1 time: 0.151991 Aug 03 13:05:47.074019 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 352/704] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:46 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:47.277321 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-859c8ae7-22a4-4f18-acac-7aaf37d928dd tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:47.277948 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-859c8ae7-22a4-4f18-acac-7aaf37d928dd tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:47.284941 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-859c8ae7-22a4-4f18-acac-7aaf37d928dd tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:47.285390 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-859c8ae7-22a4-4f18-acac-7aaf37d928dd tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:47.286143 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-859c8ae7-22a4-4f18-acac-7aaf37d928dd tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:47.286577 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-859c8ae7-22a4-4f18-acac-7aaf37d928dd tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:47.420451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-859c8ae7-22a4-4f18-acac-7aaf37d928dd tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:47.427945 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-859c8ae7-22a4-4f18-acac-7aaf37d928dd tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1265 microversion: 2.1 time: 0.154473 Aug 03 13:05:47.428539 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 353/705] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:47 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:47.509676 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-fd846ca4-bb56-4792-b618-083e2f7c8a99 req-cf8e4f81-38c8-480c-ad08-9565706c2cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e92b94-74d5-4161-ab5d-80b10c84bfb1", "name": "network-vif-plugged", "status": "completed", "tag": "0950fa19-287f-4d83-950b-1cb1355203d6"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:05:47.519777 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-fd846ca4-bb56-4792-b618-083e2f7c8a99 req-cf8e4f81-38c8-480c-ad08-9565706c2cb1 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:47.520217 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-fd846ca4-bb56-4792-b618-083e2f7c8a99 req-cf8e4f81-38c8-480c-ad08-9565706c2cb1 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:47.530836 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-fd846ca4-bb56-4792-b618-083e2f7c8a99 req-cf8e4f81-38c8-480c-ad08-9565706c2cb1 service nova] Creating event network-vif-plugged:0950fa19-287f-4d83-950b-1cb1355203d6 for instance 67e92b94-74d5-4161-ab5d-80b10c84bfb1 on hv-cinder-85083 Aug 03 13:05:47.535900 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-fd846ca4-bb56-4792-b618-083e2f7c8a99 req-cf8e4f81-38c8-480c-ad08-9565706c2cb1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084743 Aug 03 13:05:47.536512 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 353/706] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:05:47.854040 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-3eceb0fa-a332-4ffe-ba00-b74d28c44e6a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:47.854651 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-3eceb0fa-a332-4ffe-ba00-b74d28c44e6a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:47.861451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3eceb0fa-a332-4ffe-ba00-b74d28c44e6a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:47.861904 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3eceb0fa-a332-4ffe-ba00-b74d28c44e6a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:47.862698 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3eceb0fa-a332-4ffe-ba00-b74d28c44e6a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:47.863154 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3eceb0fa-a332-4ffe-ba00-b74d28c44e6a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:48.000621 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-3eceb0fa-a332-4ffe-ba00-b74d28c44e6a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:48.012058 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-3eceb0fa-a332-4ffe-ba00-b74d28c44e6a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:48.013563 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-3eceb0fa-a332-4ffe-ba00-b74d28c44e6a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:48.015632 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-3eceb0fa-a332-4ffe-ba00-b74d28c44e6a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.166178 Aug 03 13:05:48.016190 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 354/707] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:47 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:48.095561 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-97174472-677e-4e59-aff0-86badeebc7fe tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:48.096263 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-97174472-677e-4e59-aff0-86badeebc7fe tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:48.102527 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-97174472-677e-4e59-aff0-86badeebc7fe tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:48.103017 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-97174472-677e-4e59-aff0-86badeebc7fe tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:48.104327 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-97174472-677e-4e59-aff0-86badeebc7fe tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:48.104717 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-97174472-677e-4e59-aff0-86badeebc7fe tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:48.237656 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-97174472-677e-4e59-aff0-86badeebc7fe tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:48.246185 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-97174472-677e-4e59-aff0-86badeebc7fe tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1734 microversion: 2.1 time: 0.155305 Aug 03 13:05:48.246767 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 354/708] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:48 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:48.449239 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-4d91d238-fb0f-4a2a-a38b-4d04bbccba79 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:48.449940 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-4d91d238-fb0f-4a2a-a38b-4d04bbccba79 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:48.456252 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4d91d238-fb0f-4a2a-a38b-4d04bbccba79 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:48.460664 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4d91d238-fb0f-4a2a-a38b-4d04bbccba79 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:48.460664 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4d91d238-fb0f-4a2a-a38b-4d04bbccba79 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:48.460664 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4d91d238-fb0f-4a2a-a38b-4d04bbccba79 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:48.587919 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-4d91d238-fb0f-4a2a-a38b-4d04bbccba79 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:48.595897 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-4d91d238-fb0f-4a2a-a38b-4d04bbccba79 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1265 microversion: 2.1 time: 0.150534 Aug 03 13:05:48.596453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 355/709] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:48 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:49.038804 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-c103dfc9-6462-4e30-a4b8-d4b6212d2c94 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:49.039362 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-c103dfc9-6462-4e30-a4b8-d4b6212d2c94 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:49.045547 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c103dfc9-6462-4e30-a4b8-d4b6212d2c94 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:49.046006 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c103dfc9-6462-4e30-a4b8-d4b6212d2c94 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:49.046797 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c103dfc9-6462-4e30-a4b8-d4b6212d2c94 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:49.047240 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c103dfc9-6462-4e30-a4b8-d4b6212d2c94 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:49.177799 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c103dfc9-6462-4e30-a4b8-d4b6212d2c94 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:49.186815 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c103dfc9-6462-4e30-a4b8-d4b6212d2c94 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:49.188317 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c103dfc9-6462-4e30-a4b8-d4b6212d2c94 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:49.189470 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-c103dfc9-6462-4e30-a4b8-d4b6212d2c94 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.154804 Aug 03 13:05:49.190127 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 355/710] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:49 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:49.266821 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-c96ab96d-4477-4d01-9601-6db1b3b04b24 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:49.267431 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-c96ab96d-4477-4d01-9601-6db1b3b04b24 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:49.273523 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c96ab96d-4477-4d01-9601-6db1b3b04b24 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:49.273975 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c96ab96d-4477-4d01-9601-6db1b3b04b24 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:49.274761 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c96ab96d-4477-4d01-9601-6db1b3b04b24 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:49.275199 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c96ab96d-4477-4d01-9601-6db1b3b04b24 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:49.402389 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-c96ab96d-4477-4d01-9601-6db1b3b04b24 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:49.410419 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-c96ab96d-4477-4d01-9601-6db1b3b04b24 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1734 microversion: 2.1 time: 0.147457 Aug 03 13:05:49.411007 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 356/711] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:49 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:49.617145 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-f6d1a380-1ba5-4a1e-9ac6-6e6492765621 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:49.617681 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-f6d1a380-1ba5-4a1e-9ac6-6e6492765621 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:49.624516 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f6d1a380-1ba5-4a1e-9ac6-6e6492765621 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:49.624962 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f6d1a380-1ba5-4a1e-9ac6-6e6492765621 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:49.625712 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f6d1a380-1ba5-4a1e-9ac6-6e6492765621 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:49.626141 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f6d1a380-1ba5-4a1e-9ac6-6e6492765621 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:49.754817 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-f6d1a380-1ba5-4a1e-9ac6-6e6492765621 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:49.762171 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-f6d1a380-1ba5-4a1e-9ac6-6e6492765621 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1265 microversion: 2.1 time: 0.149107 Aug 03 13:05:49.762740 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 356/712] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:49 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:50.213759 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-76ebbb3a-2793-4549-b567-4789024a368b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:50.214367 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-76ebbb3a-2793-4549-b567-4789024a368b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:50.220412 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-76ebbb3a-2793-4549-b567-4789024a368b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:50.220865 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-76ebbb3a-2793-4549-b567-4789024a368b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:50.221617 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-76ebbb3a-2793-4549-b567-4789024a368b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:50.222051 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-76ebbb3a-2793-4549-b567-4789024a368b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:50.350712 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-76ebbb3a-2793-4549-b567-4789024a368b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:50.359158 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-76ebbb3a-2793-4549-b567-4789024a368b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:50.360648 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-76ebbb3a-2793-4549-b567-4789024a368b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:50.361789 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-76ebbb3a-2793-4549-b567-4789024a368b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.152715 Aug 03 13:05:50.362337 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 357/713] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:50 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:50.435197 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-ea03e8b2-2d3b-476e-9190-fec83a8940f2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:50.441443 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-ea03e8b2-2d3b-476e-9190-fec83a8940f2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:50.442244 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ea03e8b2-2d3b-476e-9190-fec83a8940f2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:50.442690 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ea03e8b2-2d3b-476e-9190-fec83a8940f2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:50.443474 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ea03e8b2-2d3b-476e-9190-fec83a8940f2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:50.443902 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ea03e8b2-2d3b-476e-9190-fec83a8940f2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:50.574549 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ea03e8b2-2d3b-476e-9190-fec83a8940f2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:50.583098 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-ea03e8b2-2d3b-476e-9190-fec83a8940f2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1734 microversion: 2.1 time: 0.153651 Aug 03 13:05:50.583670 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 357/714] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:50 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:50.783001 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-6b0e8a3a-da4b-4202-a426-5f200f64286a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:50.783590 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-6b0e8a3a-da4b-4202-a426-5f200f64286a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:50.790745 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6b0e8a3a-da4b-4202-a426-5f200f64286a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:50.791217 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6b0e8a3a-da4b-4202-a426-5f200f64286a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:50.791994 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6b0e8a3a-da4b-4202-a426-5f200f64286a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:50.792432 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6b0e8a3a-da4b-4202-a426-5f200f64286a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:50.923715 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-6b0e8a3a-da4b-4202-a426-5f200f64286a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:50.931379 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-6b0e8a3a-da4b-4202-a426-5f200f64286a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1265 microversion: 2.1 time: 0.152653 Aug 03 13:05:50.932555 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 358/715] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:50 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:51.384699 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-db776f91-cb6b-4ba6-97e5-a2274cba7b7c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:51.384923 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-db776f91-cb6b-4ba6-97e5-a2274cba7b7c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:51.390920 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-db776f91-cb6b-4ba6-97e5-a2274cba7b7c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:51.391360 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-db776f91-cb6b-4ba6-97e5-a2274cba7b7c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:51.392119 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-db776f91-cb6b-4ba6-97e5-a2274cba7b7c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:51.392553 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-db776f91-cb6b-4ba6-97e5-a2274cba7b7c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:51.526287 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-db776f91-cb6b-4ba6-97e5-a2274cba7b7c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:51.535495 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-db776f91-cb6b-4ba6-97e5-a2274cba7b7c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:51.537141 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-db776f91-cb6b-4ba6-97e5-a2274cba7b7c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:51.538374 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-db776f91-cb6b-4ba6-97e5-a2274cba7b7c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.158436 Aug 03 13:05:51.541050 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 358/716] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:51 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:51.605445 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-a1b00222-73e2-4a4f-af2c-387050a16921 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:51.606058 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-a1b00222-73e2-4a4f-af2c-387050a16921 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:51.612621 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a1b00222-73e2-4a4f-af2c-387050a16921 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:51.613073 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a1b00222-73e2-4a4f-af2c-387050a16921 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:51.613834 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a1b00222-73e2-4a4f-af2c-387050a16921 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:51.614269 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a1b00222-73e2-4a4f-af2c-387050a16921 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:51.749175 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-a1b00222-73e2-4a4f-af2c-387050a16921 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:51.757150 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-a1b00222-73e2-4a4f-af2c-387050a16921 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1734 microversion: 2.1 time: 0.156504 Aug 03 13:05:51.757697 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 359/717] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:51 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:51.953261 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-f760382b-7370-4e6e-8681-29bf8fe9892a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:51.953876 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-f760382b-7370-4e6e-8681-29bf8fe9892a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:51.959851 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f760382b-7370-4e6e-8681-29bf8fe9892a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:51.960301 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f760382b-7370-4e6e-8681-29bf8fe9892a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:51.961067 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f760382b-7370-4e6e-8681-29bf8fe9892a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:51.961508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f760382b-7370-4e6e-8681-29bf8fe9892a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:51.980402 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:05:52.095718 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-f760382b-7370-4e6e-8681-29bf8fe9892a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:52.103342 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-f760382b-7370-4e6e-8681-29bf8fe9892a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1265 microversion: 2.1 time: 0.153857 Aug 03 13:05:52.103913 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 359/718] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:51 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:52.561784 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-4f9dff73-9af7-4139-a4bd-bad69c2efd45 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:52.562314 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-4f9dff73-9af7-4139-a4bd-bad69c2efd45 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:52.568524 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4f9dff73-9af7-4139-a4bd-bad69c2efd45 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:52.568971 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4f9dff73-9af7-4139-a4bd-bad69c2efd45 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:52.569724 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4f9dff73-9af7-4139-a4bd-bad69c2efd45 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:52.570207 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4f9dff73-9af7-4139-a4bd-bad69c2efd45 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:52.701992 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-4f9dff73-9af7-4139-a4bd-bad69c2efd45 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:52.710532 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-4f9dff73-9af7-4139-a4bd-bad69c2efd45 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:52.712076 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-4f9dff73-9af7-4139-a4bd-bad69c2efd45 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:52.717389 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-4f9dff73-9af7-4139-a4bd-bad69c2efd45 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1809 microversion: 2.20 time: 0.155407 Aug 03 13:05:52.717389 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 360/719] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:52 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:52.779110 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-f537e285-38fa-43c1-8937-1b2cb7eae0a0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:52.779719 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-f537e285-38fa-43c1-8937-1b2cb7eae0a0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:52.787130 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f537e285-38fa-43c1-8937-1b2cb7eae0a0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:52.787583 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f537e285-38fa-43c1-8937-1b2cb7eae0a0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:52.788376 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f537e285-38fa-43c1-8937-1b2cb7eae0a0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:52.788810 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f537e285-38fa-43c1-8937-1b2cb7eae0a0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:53.123916 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-20a04776-a3d4-474a-9a42-3a281ce61aa3 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:53.124533 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-20a04776-a3d4-474a-9a42-3a281ce61aa3 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:53.128544 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-f537e285-38fa-43c1-8937-1b2cb7eae0a0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:53.130926 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-20a04776-a3d4-474a-9a42-3a281ce61aa3 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:53.134183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-20a04776-a3d4-474a-9a42-3a281ce61aa3 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:53.134183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-20a04776-a3d4-474a-9a42-3a281ce61aa3 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:53.134183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-20a04776-a3d4-474a-9a42-3a281ce61aa3 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:53.137479 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-f537e285-38fa-43c1-8937-1b2cb7eae0a0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1734 microversion: 2.1 time: 0.362823 Aug 03 13:05:53.138157 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 360/720] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:52 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1734 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:53.261827 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-20a04776-a3d4-474a-9a42-3a281ce61aa3 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:53.269226 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-20a04776-a3d4-474a-9a42-3a281ce61aa3 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1265 microversion: 2.1 time: 0.149376 Aug 03 13:05:53.269791 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 361/721] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:53 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:05:53.737521 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-177f6d75-ab0f-41c7-b22a-a6a46f4e81fa tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:53.738131 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-177f6d75-ab0f-41c7-b22a-a6a46f4e81fa tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:53.744824 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-177f6d75-ab0f-41c7-b22a-a6a46f4e81fa tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:53.745280 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-177f6d75-ab0f-41c7-b22a-a6a46f4e81fa tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:53.746066 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-177f6d75-ab0f-41c7-b22a-a6a46f4e81fa tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:53.746509 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-177f6d75-ab0f-41c7-b22a-a6a46f4e81fa tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:53.873650 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-177f6d75-ab0f-41c7-b22a-a6a46f4e81fa tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:53.881959 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-177f6d75-ab0f-41c7-b22a-a6a46f4e81fa tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:53.883496 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-177f6d75-ab0f-41c7-b22a-a6a46f4e81fa tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:53.884660 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-177f6d75-ab0f-41c7-b22a-a6a46f4e81fa tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1796 microversion: 2.20 time: 0.151072 Aug 03 13:05:53.885870 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 361/722] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:05:53 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1796 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:05:54.159852 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-63631c67-9b61-4b6a-a5d2-81d08d3141dc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:54.160461 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-63631c67-9b61-4b6a-a5d2-81d08d3141dc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:54.167421 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-63631c67-9b61-4b6a-a5d2-81d08d3141dc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:54.167863 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-63631c67-9b61-4b6a-a5d2-81d08d3141dc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:54.168620 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-63631c67-9b61-4b6a-a5d2-81d08d3141dc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:54.169051 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-63631c67-9b61-4b6a-a5d2-81d08d3141dc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:54.289905 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-bc3df558-82e9-4397-b30f-86b2f80666c2 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:54.290610 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-bc3df558-82e9-4397-b30f-86b2f80666c2 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:54.297317 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bc3df558-82e9-4397-b30f-86b2f80666c2 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:54.297968 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bc3df558-82e9-4397-b30f-86b2f80666c2 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:54.298762 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bc3df558-82e9-4397-b30f-86b2f80666c2 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:54.299365 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bc3df558-82e9-4397-b30f-86b2f80666c2 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:54.300000 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-63631c67-9b61-4b6a-a5d2-81d08d3141dc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:54.308794 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-63631c67-9b61-4b6a-a5d2-81d08d3141dc tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1734 microversion: 2.1 time: 0.153002 Aug 03 13:05:54.309377 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 362/723] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:54 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:54.436078 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-bc3df558-82e9-4397-b30f-86b2f80666c2 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:54.443621 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-bc3df558-82e9-4397-b30f-86b2f80666c2 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1265 microversion: 2.1 time: 0.157548 Aug 03 13:05:54.444192 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 362/724] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:54 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:05:55.329926 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-25775aa8-cf18-4311-9e71-d61b46d20ed4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:55.330574 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-25775aa8-cf18-4311-9e71-d61b46d20ed4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:55.337153 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-25775aa8-cf18-4311-9e71-d61b46d20ed4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:55.337600 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-25775aa8-cf18-4311-9e71-d61b46d20ed4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:55.338371 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-25775aa8-cf18-4311-9e71-d61b46d20ed4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:55.338831 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-25775aa8-cf18-4311-9e71-d61b46d20ed4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:55.462523 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-25775aa8-cf18-4311-9e71-d61b46d20ed4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:55.463744 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-31c111a5-9a7b-472c-9fdc-19539a01870f tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:55.464354 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-31c111a5-9a7b-472c-9fdc-19539a01870f tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:55.470611 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-25775aa8-cf18-4311-9e71-d61b46d20ed4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1734 microversion: 2.1 time: 0.144606 Aug 03 13:05:55.470901 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-31c111a5-9a7b-472c-9fdc-19539a01870f tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:55.471208 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 363/725] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:55 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1734 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:55.471330 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-31c111a5-9a7b-472c-9fdc-19539a01870f tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:55.472086 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-31c111a5-9a7b-472c-9fdc-19539a01870f tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:55.472520 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-31c111a5-9a7b-472c-9fdc-19539a01870f tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:55.605637 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-31c111a5-9a7b-472c-9fdc-19539a01870f tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:55.612951 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-31c111a5-9a7b-472c-9fdc-19539a01870f tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1265 microversion: 2.1 time: 0.153086 Aug 03 13:05:55.613519 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 363/726] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:55 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:55.777815 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-abf9c4d2-0d8c-406f-b139-5ece1109ad2e req-67b44b6c-56ec-4333-a042-7deca41cb8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d598c3-1b65-4871-b23f-ffb42f3551aa", "name": "network-vif-plugged", "status": "completed", "tag": "7d6c0cd1-c2da-4bd5-9c58-1f68951fec25"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:05:55.787625 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-abf9c4d2-0d8c-406f-b139-5ece1109ad2e req-67b44b6c-56ec-4333-a042-7deca41cb8f9 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:55.788072 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-abf9c4d2-0d8c-406f-b139-5ece1109ad2e req-67b44b6c-56ec-4333-a042-7deca41cb8f9 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:55.799326 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-abf9c4d2-0d8c-406f-b139-5ece1109ad2e req-67b44b6c-56ec-4333-a042-7deca41cb8f9 service nova] Creating event network-vif-plugged:7d6c0cd1-c2da-4bd5-9c58-1f68951fec25 for instance b9d598c3-1b65-4871-b23f-ffb42f3551aa on hv-cinder-85083 Aug 03 13:05:55.804426 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-abf9c4d2-0d8c-406f-b139-5ece1109ad2e req-67b44b6c-56ec-4333-a042-7deca41cb8f9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030729 Aug 03 13:05:55.805044 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 364/727] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:05:56.492470 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1fa05195-ea00-4140-9d30-bf584f2a5a86 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:56.493077 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-1fa05195-ea00-4140-9d30-bf584f2a5a86 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:56.500539 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1fa05195-ea00-4140-9d30-bf584f2a5a86 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:56.500995 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1fa05195-ea00-4140-9d30-bf584f2a5a86 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:56.501761 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1fa05195-ea00-4140-9d30-bf584f2a5a86 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:56.502200 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1fa05195-ea00-4140-9d30-bf584f2a5a86 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:56.631370 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-1fa05195-ea00-4140-9d30-bf584f2a5a86 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:56.635531 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-82baee37-6204-45f7-91c5-e0ad83a8dcaf tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:56.636224 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-82baee37-6204-45f7-91c5-e0ad83a8dcaf tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:56.639380 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-1fa05195-ea00-4140-9d30-bf584f2a5a86 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1734 microversion: 2.1 time: 0.150856 Aug 03 13:05:56.639957 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 364/728] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:56 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:56.642455 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-82baee37-6204-45f7-91c5-e0ad83a8dcaf tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:56.642957 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-82baee37-6204-45f7-91c5-e0ad83a8dcaf tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:56.643714 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-82baee37-6204-45f7-91c5-e0ad83a8dcaf tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:56.644143 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-82baee37-6204-45f7-91c5-e0ad83a8dcaf tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:56.774249 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-82baee37-6204-45f7-91c5-e0ad83a8dcaf tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:56.782217 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-82baee37-6204-45f7-91c5-e0ad83a8dcaf tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1265 microversion: 2.1 time: 0.151332 Aug 03 13:05:56.783267 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 365/729] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:56 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:57.661474 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-16515079-d2d5-4b88-8be6-ec532f504ef2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:57.662102 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-16515079-d2d5-4b88-8be6-ec532f504ef2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:57.669140 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-16515079-d2d5-4b88-8be6-ec532f504ef2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:57.669592 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-16515079-d2d5-4b88-8be6-ec532f504ef2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:57.670355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-16515079-d2d5-4b88-8be6-ec532f504ef2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:57.670818 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-16515079-d2d5-4b88-8be6-ec532f504ef2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:57.803575 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-64817369-f276-4329-bc90-631ea2b664ac tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:57.804059 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-16515079-d2d5-4b88-8be6-ec532f504ef2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:57.804171 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-64817369-f276-4329-bc90-631ea2b664ac tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:57.811570 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-64817369-f276-4329-bc90-631ea2b664ac tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:57.812022 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-64817369-f276-4329-bc90-631ea2b664ac tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:57.812789 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-64817369-f276-4329-bc90-631ea2b664ac tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:57.813222 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-64817369-f276-4329-bc90-631ea2b664ac tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:57.813727 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-16515079-d2d5-4b88-8be6-ec532f504ef2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1734 microversion: 2.1 time: 0.156411 Aug 03 13:05:57.814320 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 365/730] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:57 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:57.941322 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-64817369-f276-4329-bc90-631ea2b664ac tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:57.948686 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-64817369-f276-4329-bc90-631ea2b664ac tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1265 microversion: 2.1 time: 0.149046 Aug 03 13:05:57.949286 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 366/731] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:57 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:05:58.837557 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-f5ca6dcd-cafd-481f-aa61-66939d8ebefa tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:58.838263 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-f5ca6dcd-cafd-481f-aa61-66939d8ebefa tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:58.844637 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f5ca6dcd-cafd-481f-aa61-66939d8ebefa tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:58.845090 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f5ca6dcd-cafd-481f-aa61-66939d8ebefa tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:58.845850 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f5ca6dcd-cafd-481f-aa61-66939d8ebefa tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:58.846290 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f5ca6dcd-cafd-481f-aa61-66939d8ebefa tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:58.968968 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-4dc091c8-f36d-4087-8ed2-6ad20cebf193 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:58.969686 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-4dc091c8-f36d-4087-8ed2-6ad20cebf193 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:58.972281 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:05:58.977014 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4dc091c8-f36d-4087-8ed2-6ad20cebf193 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:58.977458 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4dc091c8-f36d-4087-8ed2-6ad20cebf193 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:58.977823 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-f5ca6dcd-cafd-481f-aa61-66939d8ebefa tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:58.978277 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4dc091c8-f36d-4087-8ed2-6ad20cebf193 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:58.978706 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4dc091c8-f36d-4087-8ed2-6ad20cebf193 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:58.985954 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-f5ca6dcd-cafd-481f-aa61-66939d8ebefa tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1734 microversion: 2.1 time: 0.152304 Aug 03 13:05:58.986530 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 366/732] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:58 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:05:59.107698 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-4dc091c8-f36d-4087-8ed2-6ad20cebf193 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:59.115266 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-4dc091c8-f36d-4087-8ed2-6ad20cebf193 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1452 microversion: 2.1 time: 0.150242 Aug 03 13:05:59.115829 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 367/733] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:58 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:05:59.135479 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-24cbba46-4c8f-4eec-8d2c-120c63bdce2e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:05:59.136086 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-24cbba46-4c8f-4eec-8d2c-120c63bdce2e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:05:59.142180 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-24cbba46-4c8f-4eec-8d2c-120c63bdce2e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:59.142628 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-24cbba46-4c8f-4eec-8d2c-120c63bdce2e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:59.143428 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-24cbba46-4c8f-4eec-8d2c-120c63bdce2e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:05:59.143879 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-24cbba46-4c8f-4eec-8d2c-120c63bdce2e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:05:59.271089 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-24cbba46-4c8f-4eec-8d2c-120c63bdce2e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:05:59.279052 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-24cbba46-4c8f-4eec-8d2c-120c63bdce2e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1452 microversion: 2.1 time: 0.147857 Aug 03 13:05:59.279621 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 367/734] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:05:59 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:00.008721 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-1c719fcb-3bf2-4339-990e-5d750cc6e22e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:00.009466 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-1c719fcb-3bf2-4339-990e-5d750cc6e22e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:00.016653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1c719fcb-3bf2-4339-990e-5d750cc6e22e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:00.017101 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1c719fcb-3bf2-4339-990e-5d750cc6e22e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:00.017871 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1c719fcb-3bf2-4339-990e-5d750cc6e22e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:00.018363 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1c719fcb-3bf2-4339-990e-5d750cc6e22e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:00.152072 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-1c719fcb-3bf2-4339-990e-5d750cc6e22e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:00.164367 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-1c719fcb-3bf2-4339-990e-5d750cc6e22e tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1734 microversion: 2.1 time: 0.159544 Aug 03 13:06:00.164950 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 368/735] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:00 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:01.185281 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-790b6793-64c0-4d20-b7d7-b5f1a431d0d3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:01.185883 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-790b6793-64c0-4d20-b7d7-b5f1a431d0d3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:01.192419 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-790b6793-64c0-4d20-b7d7-b5f1a431d0d3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:01.193777 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-790b6793-64c0-4d20-b7d7-b5f1a431d0d3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:01.193777 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-790b6793-64c0-4d20-b7d7-b5f1a431d0d3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:01.194166 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-790b6793-64c0-4d20-b7d7-b5f1a431d0d3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:01.256792 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-ba8c01de-f8de-4eab-bba1-bd1f07856fbd req-ebd4a9aa-5066-4d5e-af66-ba5d5c59e1fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9d598c3-1b65-4871-b23f-ffb42f3551aa", "tag": "7d6c0cd1-c2da-4bd5-9c58-1f68951fec25"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:06:01.267761 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-ba8c01de-f8de-4eab-bba1-bd1f07856fbd req-ebd4a9aa-5066-4d5e-af66-ba5d5c59e1fc service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:01.268204 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-ba8c01de-f8de-4eab-bba1-bd1f07856fbd req-ebd4a9aa-5066-4d5e-af66-ba5d5c59e1fc service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:01.281539 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-ba8c01de-f8de-4eab-bba1-bd1f07856fbd req-ebd4a9aa-5066-4d5e-af66-ba5d5c59e1fc service nova] Creating event network-changed:7d6c0cd1-c2da-4bd5-9c58-1f68951fec25 for instance b9d598c3-1b65-4871-b23f-ffb42f3551aa on hv-cinder-85083 Aug 03 13:06:01.287319 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-ba8c01de-f8de-4eab-bba1-bd1f07856fbd req-ebd4a9aa-5066-4d5e-af66-ba5d5c59e1fc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034237 Aug 03 13:06:01.287928 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 369/736] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:06:01.331492 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-790b6793-64c0-4d20-b7d7-b5f1a431d0d3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:01.340336 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-790b6793-64c0-4d20-b7d7-b5f1a431d0d3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1734 microversion: 2.1 time: 0.158758 Aug 03 13:06:01.341216 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 368/737] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:01 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:02.363476 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-b780f0a5-68ee-4391-b692-9a93f911b7fe tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:02.364300 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-b780f0a5-68ee-4391-b692-9a93f911b7fe tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:02.371140 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b780f0a5-68ee-4391-b692-9a93f911b7fe tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:02.371526 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b780f0a5-68ee-4391-b692-9a93f911b7fe tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:02.372297 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b780f0a5-68ee-4391-b692-9a93f911b7fe tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:02.372733 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b780f0a5-68ee-4391-b692-9a93f911b7fe tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:02.506310 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b780f0a5-68ee-4391-b692-9a93f911b7fe tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:02.510539 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=100 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:06:02.515355 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-b780f0a5-68ee-4391-b692-9a93f911b7fe tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1734 microversion: 2.1 time: 0.156555 Aug 03 13:06:02.520680 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 370/738] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:02 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:03.536774 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-8a381cbe-7611-4884-aaae-8c9589e03b75 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:03.537415 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-8a381cbe-7611-4884-aaae-8c9589e03b75 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:03.544903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8a381cbe-7611-4884-aaae-8c9589e03b75 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:03.545360 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8a381cbe-7611-4884-aaae-8c9589e03b75 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:03.546121 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8a381cbe-7611-4884-aaae-8c9589e03b75 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:03.546563 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8a381cbe-7611-4884-aaae-8c9589e03b75 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:03.671985 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-8a381cbe-7611-4884-aaae-8c9589e03b75 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:03.679897 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-8a381cbe-7611-4884-aaae-8c9589e03b75 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1734 microversion: 2.1 time: 0.147360 Aug 03 13:06:03.680464 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 369/739] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:03 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:04.701218 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-f31a4080-1a5d-49d7-8b9f-ba6c7356984f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:04.701824 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-f31a4080-1a5d-49d7-8b9f-ba6c7356984f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:04.709209 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f31a4080-1a5d-49d7-8b9f-ba6c7356984f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:04.709652 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f31a4080-1a5d-49d7-8b9f-ba6c7356984f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:04.710396 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f31a4080-1a5d-49d7-8b9f-ba6c7356984f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:04.710850 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f31a4080-1a5d-49d7-8b9f-ba6c7356984f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:04.841209 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-f31a4080-1a5d-49d7-8b9f-ba6c7356984f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:04.848995 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-f31a4080-1a5d-49d7-8b9f-ba6c7356984f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1734 microversion: 2.1 time: 0.152298 Aug 03 13:06:04.849550 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 371/740] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:04 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:05.870470 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-70483e07-0e31-4b0f-a610-37a4e76aade8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:05.871169 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-70483e07-0e31-4b0f-a610-37a4e76aade8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:05.877639 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-70483e07-0e31-4b0f-a610-37a4e76aade8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:05.878090 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-70483e07-0e31-4b0f-a610-37a4e76aade8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:05.878874 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-70483e07-0e31-4b0f-a610-37a4e76aade8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:05.879311 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-70483e07-0e31-4b0f-a610-37a4e76aade8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:06.006644 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-70483e07-0e31-4b0f-a610-37a4e76aade8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:06.014631 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-70483e07-0e31-4b0f-a610-37a4e76aade8 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1734 microversion: 2.1 time: 0.148566 Aug 03 13:06:06.015227 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 370/741] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:05 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:07.035651 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-669927fb-7726-4f56-b643-c679478d30a3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:07.036186 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-669927fb-7726-4f56-b643-c679478d30a3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:07.042726 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-669927fb-7726-4f56-b643-c679478d30a3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:07.043196 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-669927fb-7726-4f56-b643-c679478d30a3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:07.043939 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-669927fb-7726-4f56-b643-c679478d30a3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:07.044364 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-669927fb-7726-4f56-b643-c679478d30a3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:07.172013 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-669927fb-7726-4f56-b643-c679478d30a3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:07.179863 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-669927fb-7726-4f56-b643-c679478d30a3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1734 microversion: 2.1 time: 0.148343 Aug 03 13:06:07.180460 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 372/742] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:07 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:08.200836 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-352f6fc9-43c0-45fb-8035-17bc899d64bf tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:08.201480 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-352f6fc9-43c0-45fb-8035-17bc899d64bf tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:08.208216 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-352f6fc9-43c0-45fb-8035-17bc899d64bf tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:08.208665 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-352f6fc9-43c0-45fb-8035-17bc899d64bf tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:08.209427 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-352f6fc9-43c0-45fb-8035-17bc899d64bf tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:08.209865 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-352f6fc9-43c0-45fb-8035-17bc899d64bf tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:08.345599 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-352f6fc9-43c0-45fb-8035-17bc899d64bf tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:08.349081 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-352f6fc9-43c0-45fb-8035-17bc899d64bf tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1714 microversion: 2.1 time: 0.152046 Aug 03 13:06:08.349651 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 371/743] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:08 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1714 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:08.414229 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-65e05952-f2d3-4196-8d7d-0f235b99334a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:08.414724 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-65e05952-f2d3-4196-8d7d-0f235b99334a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:08.421742 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-65e05952-f2d3-4196-8d7d-0f235b99334a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:08.422186 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-65e05952-f2d3-4196-8d7d-0f235b99334a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:08.422972 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-65e05952-f2d3-4196-8d7d-0f235b99334a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:08.423402 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-65e05952-f2d3-4196-8d7d-0f235b99334a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:08.544914 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-65e05952-f2d3-4196-8d7d-0f235b99334a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] HTTP exception thrown: Cannot 'detach_volume' instance 76bb2b00-bafa-4b66-98f4-882ae210fe14 while it is in vm_state rescued Aug 03 13:06:08.546536 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-65e05952-f2d3-4196-8d7d-0f235b99334a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Request method failure captured: Aug 03 13:06:08.546536 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: DELETE /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14/os-volume_attachments/797f90c8-0ac4-44d2-b116-4ac961ee4cf9 HTTP/1.1 Aug 03 13:06:08.546536 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 13:06:08.546536 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 13:06:08.546536 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 13:06:08.546536 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 0 Aug 03 13:06:08.546536 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 13:06:08.546536 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 13:06:08.546536 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 13:06:08.546536 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 13:06:08.546536 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nEyeq1aA1DnWg7YkrE7D7bgGX9PT3-iXVy9M8Ibjz8s_-Ya_DEsxR7W_QOmRw1tPup_D6mHy2sBVRW5GVp8rEJSTe-zvtUT4dMGtJrZFsYShgkC-wDTETwNYIQHR5pBl-lDcgJcvGJPrB8PSIjI-ebaXTKQTexfbZ3prTy1VXvIMP0 Aug 03 13:06:08.546536 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 13:06:08.546536 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 13:06:08.546536 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 13:06:08.546536 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 13:06:08.546536 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 13:06:08.546536 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 13:06:08.546536 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: 6be1056fe005471f83a0633c99c0b349 Aug 03 13:06:08.546536 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1367109722 Aug 03 13:06:08.546536 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 13:06:08.546536 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 13:06:08.548131 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6be1056fe005471f83a0633c99c0b349"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6be1056fe005471f83a0633c99c0b349"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6be1056fe005471f83a0633c99c0b349"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6be1056fe005471f83a0633c99c0b349", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:06:08.548131 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1367109722 Aug 03 13:06:08.548131 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: 6be1056fe005471f83a0633c99c0b349 Aug 03 13:06:08.548131 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1367109722 Aug 03 13:06:08.548131 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-ServerRescueNegativeTestJSON-1367109722-project Aug 03 13:06:08.548131 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 13:06:08.548131 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 13:06:08.548131 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: bb5f78a0ee0642c7bbde2ecf34e090d0 Aug 03 13:06:08.548131 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1367109722-project Aug 03 13:06:08.548131 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: > Aug 03 13:06:08.548131 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Cannot 'detach_volume' instance 76bb2b00-bafa-4b66-98f4-882ae210fe14 while it is in vm_state rescued Aug 03 13:06:08.548897 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'server_id': '76bb2b00-bafa-4b66-98f4-882ae210fe14', 'id': '797f90c8-0ac4-44d2-b116-4ac961ee4cf9'} Aug 03 13:06:08.548897 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:06:08.548897 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:06:08.548897 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 03 13:06:08.548897 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 03 13:06:08.548897 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 13:06:08.548897 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 13:06:08.548897 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 13:06:08.548897 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 13:06:08.548897 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 76bb2b00-bafa-4b66-98f4-882ae210fe14 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 03 13:06:08.548897 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:06:08.548897 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:06:08.548897 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:06:08.548897 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:06:08.548897 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:06:08.548897 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:06:08.548897 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:06:08.548897 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:06:08.548897 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:06:08.548897 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:06:08.550147 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 03 13:06:08.550147 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 13:06:08.550147 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 13:06:08.550147 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 13:06:08.550147 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 76bb2b00-bafa-4b66-98f4-882ae210fe14 while it is in vm_state rescued Aug 03 13:06:08.550147 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:06:08.550147 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:06:08.550147 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:06:08.550147 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:06:08.550147 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:06:08.550147 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:06:08.550147 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:06:08.550147 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:06:08.550147 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 76bb2b00-bafa-4b66-98f4-882ae210fe14 while it is in vm_state rescued Aug 03 13:06:08.550147 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:06:08.550147 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-65e05952-f2d3-4196-8d7d-0f235b99334a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Returning 409 to user: Cannot 'detach_volume' instance 76bb2b00-bafa-4b66-98f4-882ae210fe14 while it is in vm_state rescued {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:06:08.551316 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-65e05952-f2d3-4196-8d7d-0f235b99334a tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "DELETE /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14/os-volume_attachments/797f90c8-0ac4-44d2-b116-4ac961ee4cf9" status: 409 len: 152 microversion: 2.1 time: 0.137717 Aug 03 13:06:08.551316 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 373/744] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Aug 3 13:06:08 2022] DELETE /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14/os-volume_attachments/797f90c8-0ac4-44d2-b116-4ac961ee4cf9 => generated 152 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 13:06:08.557003 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-dd40d797-6c39-45d1-b80e-3e78aad5ef5f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:06:08.557611 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-dd40d797-6c39-45d1-b80e-3e78aad5ef5f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:08.563573 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-dd40d797-6c39-45d1-b80e-3e78aad5ef5f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:08.564078 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-dd40d797-6c39-45d1-b80e-3e78aad5ef5f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:08.564840 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-dd40d797-6c39-45d1-b80e-3e78aad5ef5f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:08.565280 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-dd40d797-6c39-45d1-b80e-3e78aad5ef5f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:08.782099 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-dd40d797-6c39-45d1-b80e-3e78aad5ef5f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "POST /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14/action" status: 202 len: 0 microversion: 2.1 time: 0.228671 Aug 03 13:06:08.782588 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 372/745] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Aug 3 13:06:08 2022] POST /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 13:06:08.791434 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-8d1ee8b4-b86f-460d-ad5c-7eda94caf1cf tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:08.792104 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-8d1ee8b4-b86f-460d-ad5c-7eda94caf1cf tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:08.798896 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8d1ee8b4-b86f-460d-ad5c-7eda94caf1cf tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:08.799346 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8d1ee8b4-b86f-460d-ad5c-7eda94caf1cf tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:08.800116 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8d1ee8b4-b86f-460d-ad5c-7eda94caf1cf tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:08.800553 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8d1ee8b4-b86f-460d-ad5c-7eda94caf1cf tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:08.928606 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-8d1ee8b4-b86f-460d-ad5c-7eda94caf1cf tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:08.938852 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-8d1ee8b4-b86f-460d-ad5c-7eda94caf1cf tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1722 microversion: 2.1 time: 0.151712 Aug 03 13:06:08.939612 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 374/746] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:08 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:06:09.961602 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-b7411fc8-bcfe-4374-ad9e-aaeb0c776d17 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:09.962296 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-b7411fc8-bcfe-4374-ad9e-aaeb0c776d17 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:09.969049 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b7411fc8-bcfe-4374-ad9e-aaeb0c776d17 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:09.969498 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b7411fc8-bcfe-4374-ad9e-aaeb0c776d17 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:09.970256 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b7411fc8-bcfe-4374-ad9e-aaeb0c776d17 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:09.970694 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b7411fc8-bcfe-4374-ad9e-aaeb0c776d17 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:10.104205 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-b7411fc8-bcfe-4374-ad9e-aaeb0c776d17 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:10.112081 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-b7411fc8-bcfe-4374-ad9e-aaeb0c776d17 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1722 microversion: 2.1 time: 0.155270 Aug 03 13:06:10.112650 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 373/747] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:09 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:11.133460 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-4fec06f9-9c26-48a3-9447-12f468acdd33 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:11.133994 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-4fec06f9-9c26-48a3-9447-12f468acdd33 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:11.140535 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4fec06f9-9c26-48a3-9447-12f468acdd33 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:11.140978 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4fec06f9-9c26-48a3-9447-12f468acdd33 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:11.141731 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4fec06f9-9c26-48a3-9447-12f468acdd33 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:11.142159 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4fec06f9-9c26-48a3-9447-12f468acdd33 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:11.269005 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-4fec06f9-9c26-48a3-9447-12f468acdd33 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:11.277298 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-4fec06f9-9c26-48a3-9447-12f468acdd33 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1722 microversion: 2.1 time: 0.147396 Aug 03 13:06:11.277846 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 375/748] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:11 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:12.298830 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-81826644-3ca9-43cd-b306-213fafb6be53 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:12.299465 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-81826644-3ca9-43cd-b306-213fafb6be53 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:12.306182 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-81826644-3ca9-43cd-b306-213fafb6be53 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:12.306626 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-81826644-3ca9-43cd-b306-213fafb6be53 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:12.307436 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-81826644-3ca9-43cd-b306-213fafb6be53 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:12.307867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-81826644-3ca9-43cd-b306-213fafb6be53 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:12.436486 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-81826644-3ca9-43cd-b306-213fafb6be53 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:12.444292 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-81826644-3ca9-43cd-b306-213fafb6be53 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1722 microversion: 2.1 time: 0.149228 Aug 03 13:06:12.444849 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 374/749] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:12 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:13.466295 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-72399eb8-f603-4af6-a23b-ef722c01f3b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:13.466944 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-72399eb8-f603-4af6-a23b-ef722c01f3b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:13.473559 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-72399eb8-f603-4af6-a23b-ef722c01f3b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:13.474006 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-72399eb8-f603-4af6-a23b-ef722c01f3b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:13.474789 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-72399eb8-f603-4af6-a23b-ef722c01f3b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:13.475227 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-72399eb8-f603-4af6-a23b-ef722c01f3b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:13.613051 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-72399eb8-f603-4af6-a23b-ef722c01f3b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:13.620965 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-72399eb8-f603-4af6-a23b-ef722c01f3b5 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1722 microversion: 2.1 time: 0.159290 Aug 03 13:06:13.621531 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 376/750] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:13 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:14.641316 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e81e9a5a-63da-4f1b-b24e-a6a39c69f384 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:14.641929 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-e81e9a5a-63da-4f1b-b24e-a6a39c69f384 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:14.648609 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e81e9a5a-63da-4f1b-b24e-a6a39c69f384 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:14.649063 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e81e9a5a-63da-4f1b-b24e-a6a39c69f384 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:14.649861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e81e9a5a-63da-4f1b-b24e-a6a39c69f384 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:14.650305 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e81e9a5a-63da-4f1b-b24e-a6a39c69f384 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:14.654442 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:06:14.784025 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-e81e9a5a-63da-4f1b-b24e-a6a39c69f384 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:14.792006 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-e81e9a5a-63da-4f1b-b24e-a6a39c69f384 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1728 microversion: 2.1 time: 0.154493 Aug 03 13:06:14.793080 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 375/751] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:14 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:14.813119 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-e44f9780-410c-4cb5-b3e9-3995e70881a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:14.813665 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-e44f9780-410c-4cb5-b3e9-3995e70881a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:14.820077 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e44f9780-410c-4cb5-b3e9-3995e70881a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:14.820522 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e44f9780-410c-4cb5-b3e9-3995e70881a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:14.821277 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e44f9780-410c-4cb5-b3e9-3995e70881a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:14.821708 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e44f9780-410c-4cb5-b3e9-3995e70881a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:14.904572 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-e44f9780-410c-4cb5-b3e9-3995e70881a4 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095183 Aug 03 13:06:14.905161 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 377/752] 10.222.0.64 () {58 vars in 1275 bytes} [Wed Aug 3 13:06:14 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:06:15.917376 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-0fc4f437-fb65-4b93-8725-a6617a144b04 req-30a74128-c804-4365-b1e9-832577fb1ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76bb2b00-bafa-4b66-98f4-882ae210fe14", "tag": "9b3298cc-4607-4438-a82a-2051f630b8a0"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:06:15.926479 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-0fc4f437-fb65-4b93-8725-a6617a144b04 req-30a74128-c804-4365-b1e9-832577fb1ed3 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:15.926965 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-0fc4f437-fb65-4b93-8725-a6617a144b04 req-30a74128-c804-4365-b1e9-832577fb1ed3 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:15.938108 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-0fc4f437-fb65-4b93-8725-a6617a144b04 req-30a74128-c804-4365-b1e9-832577fb1ed3 service nova] Creating event network-changed:9b3298cc-4607-4438-a82a-2051f630b8a0 for instance 76bb2b00-bafa-4b66-98f4-882ae210fe14 on hv-cinder-85083 Aug 03 13:06:15.943080 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-0fc4f437-fb65-4b93-8725-a6617a144b04 req-30a74128-c804-4365-b1e9-832577fb1ed3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085212 Aug 03 13:06:15.943947 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 376/753] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:06:17.958406 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-b4a02013-f5cd-44fd-9d56-87cd3e269ccb req-0cc09f53-e9c5-4fbf-9fb0-622567fd9acb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76bb2b00-bafa-4b66-98f4-882ae210fe14", "tag": "9b3298cc-4607-4438-a82a-2051f630b8a0"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:06:17.967719 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-b4a02013-f5cd-44fd-9d56-87cd3e269ccb req-0cc09f53-e9c5-4fbf-9fb0-622567fd9acb service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:17.968148 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-b4a02013-f5cd-44fd-9d56-87cd3e269ccb req-0cc09f53-e9c5-4fbf-9fb0-622567fd9acb service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:17.981420 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-b4a02013-f5cd-44fd-9d56-87cd3e269ccb req-0cc09f53-e9c5-4fbf-9fb0-622567fd9acb service nova] Creating event network-changed:9b3298cc-4607-4438-a82a-2051f630b8a0 for instance 76bb2b00-bafa-4b66-98f4-882ae210fe14 on hv-cinder-85083 Aug 03 13:06:17.986248 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-b4a02013-f5cd-44fd-9d56-87cd3e269ccb req-0cc09f53-e9c5-4fbf-9fb0-622567fd9acb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032034 Aug 03 13:06:17.986843 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 378/754] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:06:32.269884 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=49 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:06:32.270712 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=6 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:06:32.274700 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-7fa32a2b-5433-4bc8-be4f-40eae71fd8da tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:32.278397 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-7fa32a2b-5433-4bc8-be4f-40eae71fd8da tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 5079c8f3-b98d-4036-987d-fcac401752ed] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:32.281368 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7fa32a2b-5433-4bc8-be4f-40eae71fd8da tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:32.281813 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7fa32a2b-5433-4bc8-be4f-40eae71fd8da tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:32.282569 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7fa32a2b-5433-4bc8-be4f-40eae71fd8da tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:32.283026 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7fa32a2b-5433-4bc8-be4f-40eae71fd8da tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:32.307295 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-7fa32a2b-5433-4bc8-be4f-40eae71fd8da tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed/ips" status: 200 len: 150 microversion: 2.1 time: 0.038879 Aug 03 13:06:32.308490 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 377/755] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Aug 3 13:06:32 2022] GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:06:32.317290 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=23 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:06:32.318085 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=42 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:06:32.322231 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-37592574-eb07-421a-89ed-56c8e8581598 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64fa4683-5a6a-4a70-a1a1-624bd9d88dea"}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:06:32.325164 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-37592574-eb07-421a-89ed-56c8e8581598 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 5079c8f3-b98d-4036-987d-fcac401752ed] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:32.331590 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-37592574-eb07-421a-89ed-56c8e8581598 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:32.332032 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-37592574-eb07-421a-89ed-56c8e8581598 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:32.332779 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-37592574-eb07-421a-89ed-56c8e8581598 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:32.333204 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-37592574-eb07-421a-89ed-56c8e8581598 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:32.414648 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-37592574-eb07-421a-89ed-56c8e8581598 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] HTTP exception thrown: Invalid volume: volume 64fa4683-5a6a-4a70-a1a1-624bd9d88dea is already attached to instances: 8097a062-4988-48d8-b95f-404fdf23d14a Aug 03 13:06:32.416463 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-37592574-eb07-421a-89ed-56c8e8581598 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Request method failure captured: Aug 03 13:06:32.416463 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: POST /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed/os-volume_attachments HTTP/1.1 Aug 03 13:06:32.416463 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 13:06:32.416463 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 13:06:32.416463 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 13:06:32.416463 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 74 Aug 03 13:06:32.416463 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 13:06:32.416463 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 13:06:32.416463 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 13:06:32.416463 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 13:06:32.416463 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nE7DMH7_yawRG_EFqNprJ7tBLEAekyvd1TBnPLfkLY5FE_9FrSgGLljSycXdPTf3Im9G-ykq7spGFlIg47_VU_2Fobyvwk0dbllyHhXgHfuZGQytAsHHqjzEzu1SvE5rruA2LuPS1Zi7AyBd0EQ49IEVy0pbvx8Z15H7rrkhk-6aqQ Aug 03 13:06:32.416463 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 13:06:32.416463 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 13:06:32.416463 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 13:06:32.416463 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 13:06:32.416463 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 13:06:32.416463 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 13:06:32.416463 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: 23cfcb8de5e448b8af185376a035263b Aug 03 13:06:32.416463 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:06:32.416463 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 13:06:32.416463 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 13:06:32.418974 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_23cfcb8de5e448b8af185376a035263b", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:06:32.418974 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:06:32.418974 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: 23cfcb8de5e448b8af185376a035263b Aug 03 13:06:32.418974 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:06:32.418974 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-AttachVolumeNegativeTest-1034317644-project Aug 03 13:06:32.418974 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 13:06:32.418974 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 13:06:32.418974 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: 36693fa42a7b41279c8d8c59ecafb243 Aug 03 13:06:32.418974 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-AttachVolumeNegativeTest-1034317644-project Aug 03 13:06:32.418974 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Aug 03 13:06:32.418974 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {"volumeAttachment": {"volumeId": "64fa4683-5a6a-4a70-a1a1-624bd9d88dea"}} Aug 03 13:06:32.418974 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: > Aug 03 13:06:32.419964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Invalid volume: volume 64fa4683-5a6a-4a70-a1a1-624bd9d88dea is already attached to instances: 8097a062-4988-48d8-b95f-404fdf23d14a Aug 03 13:06:32.419964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'server_id': '5079c8f3-b98d-4036-987d-fcac401752ed', 'body': {'volumeAttachment': {'volumeId': '64fa4683-5a6a-4a70-a1a1-624bd9d88dea'}}} Aug 03 13:06:32.419964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:06:32.419964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:06:32.419964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 03 13:06:32.419964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 03 13:06:32.419964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 13:06:32.419964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 13:06:32.419964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 13:06:32.419964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 13:06:32.419964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 03 13:06:32.419964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 03 13:06:32.419964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 03 13:06:32.419964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 03 13:06:32.419964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 64fa4683-5a6a-4a70-a1a1-624bd9d88dea is already attached to instances: 8097a062-4988-48d8-b95f-404fdf23d14a Aug 03 13:06:32.419964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:06:32.419964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:06:32.419964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:06:32.419964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:06:32.421619 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:06:32.421619 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:06:32.421619 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:06:32.421619 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:06:32.421619 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:06:32.421619 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:06:32.421619 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 13:06:32.421619 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 13:06:32.421619 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 13:06:32.421619 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 13:06:32.421619 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 13:06:32.421619 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 13:06:32.421619 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 03 13:06:32.421619 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 13:06:32.421619 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 64fa4683-5a6a-4a70-a1a1-624bd9d88dea is already attached to instances: 8097a062-4988-48d8-b95f-404fdf23d14a Aug 03 13:06:32.421619 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:06:32.421619 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:06:32.421619 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:06:32.421619 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:06:32.421619 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:06:32.423025 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:06:32.423025 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:06:32.423025 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:06:32.423025 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 64fa4683-5a6a-4a70-a1a1-624bd9d88dea is already attached to instances: 8097a062-4988-48d8-b95f-404fdf23d14a Aug 03 13:06:32.423025 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:06:32.423025 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-37592574-eb07-421a-89ed-56c8e8581598 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Returning 400 to user: Invalid volume: volume 64fa4683-5a6a-4a70-a1a1-624bd9d88dea is already attached to instances: 8097a062-4988-48d8-b95f-404fdf23d14a {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:06:32.423025 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-37592574-eb07-421a-89ed-56c8e8581598 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "POST /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102686 Aug 03 13:06:32.423025 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 379/756] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Aug 3 13:06:32 2022] POST /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 13:06:32.428053 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-494d26ef-9c61-4b39-8f9c-1ee39ce55bcf tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:32.432857 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-494d26ef-9c61-4b39-8f9c-1ee39ce55bcf tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 5079c8f3-b98d-4036-987d-fcac401752ed] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:32.434941 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-494d26ef-9c61-4b39-8f9c-1ee39ce55bcf tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:32.435393 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-494d26ef-9c61-4b39-8f9c-1ee39ce55bcf tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:32.436153 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-494d26ef-9c61-4b39-8f9c-1ee39ce55bcf tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:32.436591 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-494d26ef-9c61-4b39-8f9c-1ee39ce55bcf tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:32.460746 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-494d26ef-9c61-4b39-8f9c-1ee39ce55bcf tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 5079c8f3-b98d-4036-987d-fcac401752ed] Going to try to terminate instance {{(pid=119410) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 13:06:32.707503 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-494d26ef-9c61-4b39-8f9c-1ee39ce55bcf tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "DELETE /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed" status: 204 len: 0 microversion: 2.1 time: 0.283335 Aug 03 13:06:32.708042 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 378/757] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 3 13:06:32 2022] DELETE /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 13:06:32.716544 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-60a57653-327b-476d-8507-356179ad0d45 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:32.717350 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-60a57653-327b-476d-8507-356179ad0d45 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 5079c8f3-b98d-4036-987d-fcac401752ed] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:32.724629 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-60a57653-327b-476d-8507-356179ad0d45 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:32.725093 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-60a57653-327b-476d-8507-356179ad0d45 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:32.725846 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-60a57653-327b-476d-8507-356179ad0d45 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:32.726274 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-60a57653-327b-476d-8507-356179ad0d45 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:32.860239 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-60a57653-327b-476d-8507-356179ad0d45 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:32.867663 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-60a57653-327b-476d-8507-356179ad0d45 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed" status: 200 len: 1683 microversion: 2.1 time: 0.154992 Aug 03 13:06:32.868221 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 380/758] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:32 2022] GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:33.889787 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-68b026ac-142d-45bb-8327-15e7d813a221 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:33.890470 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-68b026ac-142d-45bb-8327-15e7d813a221 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 5079c8f3-b98d-4036-987d-fcac401752ed] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:33.896893 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-68b026ac-142d-45bb-8327-15e7d813a221 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:33.897337 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-68b026ac-142d-45bb-8327-15e7d813a221 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:33.898118 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-68b026ac-142d-45bb-8327-15e7d813a221 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:33.898545 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-68b026ac-142d-45bb-8327-15e7d813a221 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:34.029995 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-68b026ac-142d-45bb-8327-15e7d813a221 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:34.037562 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-68b026ac-142d-45bb-8327-15e7d813a221 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed" status: 200 len: 1683 microversion: 2.1 time: 0.151999 Aug 03 13:06:34.038117 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 379/759] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:33 2022] GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:35.058967 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-075a2656-3443-41a3-b53b-25fc36eaa759 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:35.059530 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-075a2656-3443-41a3-b53b-25fc36eaa759 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 5079c8f3-b98d-4036-987d-fcac401752ed] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:35.066064 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-075a2656-3443-41a3-b53b-25fc36eaa759 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:35.066503 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-075a2656-3443-41a3-b53b-25fc36eaa759 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:35.067282 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-075a2656-3443-41a3-b53b-25fc36eaa759 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:35.067707 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-075a2656-3443-41a3-b53b-25fc36eaa759 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:35.202687 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-075a2656-3443-41a3-b53b-25fc36eaa759 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:35.210273 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-075a2656-3443-41a3-b53b-25fc36eaa759 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed" status: 200 len: 1683 microversion: 2.1 time: 0.155385 Aug 03 13:06:35.210864 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 381/760] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:35 2022] GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:35.792877 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-593d66ff-c0e6-42af-a1e3-c4c9390e7541 req-3868d64e-7975-4a73-93cf-36aab5d8643c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5079c8f3-b98d-4036-987d-fcac401752ed", "name": "network-vif-deleted", "tag": "acaaa8da-476e-4704-b8a2-26ab23a62fb0"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:06:35.803699 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-593d66ff-c0e6-42af-a1e3-c4c9390e7541 req-3868d64e-7975-4a73-93cf-36aab5d8643c service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:35.807399 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-593d66ff-c0e6-42af-a1e3-c4c9390e7541 req-3868d64e-7975-4a73-93cf-36aab5d8643c service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:35.815507 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-593d66ff-c0e6-42af-a1e3-c4c9390e7541 req-3868d64e-7975-4a73-93cf-36aab5d8643c service nova] Creating event network-vif-deleted:acaaa8da-476e-4704-b8a2-26ab23a62fb0 for instance 5079c8f3-b98d-4036-987d-fcac401752ed on hv-cinder-85083 Aug 03 13:06:35.820628 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-593d66ff-c0e6-42af-a1e3-c4c9390e7541 req-3868d64e-7975-4a73-93cf-36aab5d8643c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031539 Aug 03 13:06:35.821208 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 380/761] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:06:36.231716 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-5e62335d-9037-40c1-9600-6f6c7745c621 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:36.232525 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-5e62335d-9037-40c1-9600-6f6c7745c621 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 5079c8f3-b98d-4036-987d-fcac401752ed] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:36.239524 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5e62335d-9037-40c1-9600-6f6c7745c621 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:36.239972 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5e62335d-9037-40c1-9600-6f6c7745c621 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:36.241151 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5e62335d-9037-40c1-9600-6f6c7745c621 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:36.241757 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5e62335d-9037-40c1-9600-6f6c7745c621 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:36.274071 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5e62335d-9037-40c1-9600-6f6c7745c621 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:36.274514 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5e62335d-9037-40c1-9600-6f6c7745c621 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:36.274987 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.objects.instance [None req-5e62335d-9037-40c1-9600-6f6c7745c621 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lazy-loading 'fault' on Instance uuid 5079c8f3-b98d-4036-987d-fcac401752ed {{(pid=119409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:06:36.317213 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-5e62335d-9037-40c1-9600-6f6c7745c621 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:36.324908 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-5e62335d-9037-40c1-9600-6f6c7745c621 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed" status: 200 len: 1332 microversion: 2.1 time: 0.097807 Aug 03 13:06:36.325608 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 382/762] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:36 2022] GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:37.346872 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e91e8923-043d-46b7-b0e5-d14333447516 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:37.347574 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-e91e8923-043d-46b7-b0e5-d14333447516 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 5079c8f3-b98d-4036-987d-fcac401752ed] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:37.353843 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e91e8923-043d-46b7-b0e5-d14333447516 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:37.354297 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e91e8923-043d-46b7-b0e5-d14333447516 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:37.355092 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e91e8923-043d-46b7-b0e5-d14333447516 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:37.355533 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e91e8923-043d-46b7-b0e5-d14333447516 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:37.368759 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.wsgi [None req-e91e8923-043d-46b7-b0e5-d14333447516 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] HTTP exception thrown: Instance 5079c8f3-b98d-4036-987d-fcac401752ed could not be found. Aug 03 13:06:37.370895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e91e8923-043d-46b7-b0e5-d14333447516 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Request method failure captured: Aug 03 13:06:37.370895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: request: GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed HTTP/1.1 Aug 03 13:06:37.370895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept: application/json Aug 03 13:06:37.370895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept-Encoding: identity Aug 03 13:06:37.370895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Connection: close Aug 03 13:06:37.370895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Length: 0 Aug 03 13:06:37.370895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Type: application/json Aug 03 13:06:37.370895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Host: 10.222.0.64 Aug 03 13:06:37.370895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Openstack-System-Scope: None Aug 03 13:06:37.370895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: User-Agent: python-urllib3/1.26.10 Aug 03 13:06:37.370895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Auth-Token: gAAAAABi6nE7DMH7_yawRG_EFqNprJ7tBLEAekyvd1TBnPLfkLY5FE_9FrSgGLljSycXdPTf3Im9G-ykq7spGFlIg47_VU_2Fobyvwk0dbllyHhXgHfuZGQytAsHHqjzEzu1SvE5rruA2LuPS1Zi7AyBd0EQ49IEVy0pbvx8Z15H7rrkhk-6aqQ Aug 03 13:06:37.370895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Id: None Aug 03 13:06:37.370895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Name: None Aug 03 13:06:37.370895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Identity-Status: Confirmed Aug 03 13:06:37.370895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Is-Admin-Project: True Aug 03 13:06:37.370895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Id: default Aug 03 13:06:37.370895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Name: Default Aug 03 13:06:37.370895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Id: 23cfcb8de5e448b8af185376a035263b Aug 03 13:06:37.370895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Name: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:06:37.370895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Role: member,reader Aug 03 13:06:37.370895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Roles: member,reader Aug 03 13:06:37.372431 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_23cfcb8de5e448b8af185376a035263b", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:06:37.372431 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:06:37.372431 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Id: 23cfcb8de5e448b8af185376a035263b Aug 03 13:06:37.372431 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:06:37.372431 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User: tempest-AttachVolumeNegativeTest-1034317644-project Aug 03 13:06:37.372431 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Id: default Aug 03 13:06:37.372431 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Name: Default Aug 03 13:06:37.372431 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Id: 36693fa42a7b41279c8d8c59ecafb243 Aug 03 13:06:37.372431 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Name: tempest-AttachVolumeNegativeTest-1034317644-project Aug 03 13:06:37.372431 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: method: > Aug 03 13:06:37.372431 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: exception: Instance 5079c8f3-b98d-4036-987d-fcac401752ed could not be found. Aug 03 13:06:37.372431 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: action_args: {'id': '5079c8f3-b98d-4036-987d-fcac401752ed'} Aug 03 13:06:37.373209 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:06:37.373209 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:06:37.373209 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:06:37.373209 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:06:37.373209 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:06:37.373209 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:06:37.373209 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:06:37.373209 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:06:37.373209 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:06:37.373209 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:06:37.373209 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5079c8f3-b98d-4036-987d-fcac401752ed could not be found. Aug 03 13:06:37.373209 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:06:37.373209 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:06:37.373209 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:06:37.373209 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:06:37.373209 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:06:37.373209 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:06:37.373209 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:06:37.373209 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:06:37.373209 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:06:37.374487 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:06:37.374487 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:06:37.374487 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:06:37.374487 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:06:37.374487 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:06:37.374487 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:06:37.374487 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:06:37.374487 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5079c8f3-b98d-4036-987d-fcac401752ed could not be found. Aug 03 13:06:37.374487 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:06:37.374487 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:06:37.374487 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:06:37.374487 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:06:37.374487 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:06:37.374487 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:06:37.374487 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:06:37.374487 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:06:37.374487 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5079c8f3-b98d-4036-987d-fcac401752ed could not be found. Aug 03 13:06:37.374487 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:06:37.375640 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e91e8923-043d-46b7-b0e5-d14333447516 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Returning 404 to user: Instance 5079c8f3-b98d-4036-987d-fcac401752ed could not be found. {{(pid=119410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:06:37.375640 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-e91e8923-043d-46b7-b0e5-d14333447516 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed" status: 404 len: 111 microversion: 2.1 time: 0.030116 Aug 03 13:06:37.375640 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 381/763] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:37 2022] GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:06:37.381010 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-b5520796-0dac-44b4-9560-305360481a60 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '.version_select at 0x7fe6d829a430>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:37.453087 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-b5520796-0dac-44b4-9560-305360481a60 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1561300594" status: 202 len: 0 microversion: 2.1 time: 0.075723 Aug 03 13:06:37.453661 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 383/764] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Aug 3 13:06:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1561300594 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 13:06:38.241939 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1cdb8b82-bcba-469a-8698-d0ebfdd36207 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:38.242441 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-1cdb8b82-bcba-469a-8698-d0ebfdd36207 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:38.249207 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1cdb8b82-bcba-469a-8698-d0ebfdd36207 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:38.249652 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1cdb8b82-bcba-469a-8698-d0ebfdd36207 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:38.250423 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1cdb8b82-bcba-469a-8698-d0ebfdd36207 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:38.250886 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1cdb8b82-bcba-469a-8698-d0ebfdd36207 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:38.379456 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-1cdb8b82-bcba-469a-8698-d0ebfdd36207 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lazy-loading 'services' on Instance uuid 8097a062-4988-48d8-b95f-404fdf23d14a {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:06:38.594688 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-1cdb8b82-bcba-469a-8698-d0ebfdd36207 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "DELETE /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a/os-volume_attachments/64fa4683-5a6a-4a70-a1a1-624bd9d88dea" status: 202 len: 0 microversion: 2.1 time: 0.356381 Aug 03 13:06:38.595261 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 382/765] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Aug 3 13:06:38 2022] DELETE /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a/os-volume_attachments/64fa4683-5a6a-4a70-a1a1-624bd9d88dea => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 13:06:38.605177 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-e0ca5804-787c-4d95-ac6a-f04281234891 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:38.607322 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-e0ca5804-787c-4d95-ac6a-f04281234891 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:38.613953 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e0ca5804-787c-4d95-ac6a-f04281234891 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:38.614393 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e0ca5804-787c-4d95-ac6a-f04281234891 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:38.615242 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e0ca5804-787c-4d95-ac6a-f04281234891 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:38.615683 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e0ca5804-787c-4d95-ac6a-f04281234891 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:38.644056 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-e0ca5804-787c-4d95-ac6a-f04281234891 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044217 Aug 03 13:06:38.644754 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 384/766] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 3 13:06:38 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:06:39.658083 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-24890212-916f-4816-b5d4-43d5c26d9ad1 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:39.660597 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-24890212-916f-4816-b5d4-43d5c26d9ad1 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:39.667616 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-24890212-916f-4816-b5d4-43d5c26d9ad1 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:39.668112 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-24890212-916f-4816-b5d4-43d5c26d9ad1 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:39.668892 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-24890212-916f-4816-b5d4-43d5c26d9ad1 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:39.669322 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-24890212-916f-4816-b5d4-43d5c26d9ad1 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:39.697479 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-24890212-916f-4816-b5d4-43d5c26d9ad1 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044188 Aug 03 13:06:39.698015 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 383/767] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 3 13:06:39 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:06:40.709651 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-9cbfb061-2500-46e7-9446-f4f3fcd11d4d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:40.711791 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-9cbfb061-2500-46e7-9446-f4f3fcd11d4d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:40.718192 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9cbfb061-2500-46e7-9446-f4f3fcd11d4d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:40.718629 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9cbfb061-2500-46e7-9446-f4f3fcd11d4d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:40.719477 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9cbfb061-2500-46e7-9446-f4f3fcd11d4d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:40.719898 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9cbfb061-2500-46e7-9446-f4f3fcd11d4d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:40.748364 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-9cbfb061-2500-46e7-9446-f4f3fcd11d4d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042567 Aug 03 13:06:40.748908 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 385/768] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 3 13:06:40 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 13:06:40.809481 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-226facf5-82b8-4db8-9300-abeb8f810ef7 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:40.809971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-226facf5-82b8-4db8-9300-abeb8f810ef7 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:40.816284 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-226facf5-82b8-4db8-9300-abeb8f810ef7 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:40.816721 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-226facf5-82b8-4db8-9300-abeb8f810ef7 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:40.817489 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-226facf5-82b8-4db8-9300-abeb8f810ef7 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:40.817891 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-226facf5-82b8-4db8-9300-abeb8f810ef7 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:40.841632 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-226facf5-82b8-4db8-9300-abeb8f810ef7 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Going to try to terminate instance {{(pid=119410) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 13:06:41.124859 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-226facf5-82b8-4db8-9300-abeb8f810ef7 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "DELETE /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 204 len: 0 microversion: 2.1 time: 0.319453 Aug 03 13:06:41.125447 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 384/769] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 3 13:06:40 2022] DELETE /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 13:06:41.133708 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-9764ce39-bbb4-42d8-9fd7-e8ae6ed1657d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:41.134333 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-9764ce39-bbb4-42d8-9fd7-e8ae6ed1657d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:41.140390 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9764ce39-bbb4-42d8-9fd7-e8ae6ed1657d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:41.140836 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9764ce39-bbb4-42d8-9fd7-e8ae6ed1657d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:41.141581 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9764ce39-bbb4-42d8-9fd7-e8ae6ed1657d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:41.142005 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9764ce39-bbb4-42d8-9fd7-e8ae6ed1657d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:41.275328 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-9764ce39-bbb4-42d8-9fd7-e8ae6ed1657d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:41.283522 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-9764ce39-bbb4-42d8-9fd7-e8ae6ed1657d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1681 microversion: 2.1 time: 0.153371 Aug 03 13:06:41.283991 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 386/770] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:41 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:42.305984 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d8d5dd76-d8d7-4a35-ba1a-df0a380a7090 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:42.306785 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d8d5dd76-d8d7-4a35-ba1a-df0a380a7090 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:42.313481 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d8d5dd76-d8d7-4a35-ba1a-df0a380a7090 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:42.313927 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d8d5dd76-d8d7-4a35-ba1a-df0a380a7090 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:42.314678 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d8d5dd76-d8d7-4a35-ba1a-df0a380a7090 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:42.315136 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d8d5dd76-d8d7-4a35-ba1a-df0a380a7090 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:42.450401 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d8d5dd76-d8d7-4a35-ba1a-df0a380a7090 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:42.457995 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d8d5dd76-d8d7-4a35-ba1a-df0a380a7090 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1681 microversion: 2.1 time: 0.156284 Aug 03 13:06:42.458568 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 385/771] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:42 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:43.374460 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-ca484e4f-6811-47ed-8bf8-6bfc3ee3433f req-a596c075-8daa-4ad8-abcf-5d8bd4988720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8097a062-4988-48d8-b95f-404fdf23d14a", "name": "network-vif-deleted", "tag": "c5ff7ffa-b21f-405c-b9b8-d4f1c6b84415"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:06:43.384530 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-ca484e4f-6811-47ed-8bf8-6bfc3ee3433f req-a596c075-8daa-4ad8-abcf-5d8bd4988720 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:43.385104 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-ca484e4f-6811-47ed-8bf8-6bfc3ee3433f req-a596c075-8daa-4ad8-abcf-5d8bd4988720 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:43.396373 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-ca484e4f-6811-47ed-8bf8-6bfc3ee3433f req-a596c075-8daa-4ad8-abcf-5d8bd4988720 service nova] Creating event network-vif-deleted:c5ff7ffa-b21f-405c-b9b8-d4f1c6b84415 for instance 8097a062-4988-48d8-b95f-404fdf23d14a on hv-cinder-85083 Aug 03 13:06:43.402259 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-ca484e4f-6811-47ed-8bf8-6bfc3ee3433f req-a596c075-8daa-4ad8-abcf-5d8bd4988720 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031296 Aug 03 13:06:43.402874 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 387/772] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:06:43.480822 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-9edc6585-e90b-4931-9741-9dc6601e8ef5 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:43.481787 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-9edc6585-e90b-4931-9741-9dc6601e8ef5 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:43.488538 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9edc6585-e90b-4931-9741-9dc6601e8ef5 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:43.488984 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9edc6585-e90b-4931-9741-9dc6601e8ef5 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:43.489793 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9edc6585-e90b-4931-9741-9dc6601e8ef5 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:43.490261 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9edc6585-e90b-4931-9741-9dc6601e8ef5 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:43.557482 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-9edc6585-e90b-4931-9741-9dc6601e8ef5 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:43.566881 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-9edc6585-e90b-4931-9741-9dc6601e8ef5 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 200 len: 1614 microversion: 2.1 time: 0.090800 Aug 03 13:06:43.567479 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 386/773] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:43 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 1614 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:43.872762 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-5f5be1be-1b47-4f6f-a0dc-44849cae8113 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1828376528"}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:06:43.873385 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-5f5be1be-1b47-4f6f-a0dc-44849cae8113 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:43.879548 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5f5be1be-1b47-4f6f-a0dc-44849cae8113 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:43.879983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5f5be1be-1b47-4f6f-a0dc-44849cae8113 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:43.880725 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5f5be1be-1b47-4f6f-a0dc-44849cae8113 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:43.881150 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5f5be1be-1b47-4f6f-a0dc-44849cae8113 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:44.008787 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.network.security_group_api [None req-5f5be1be-1b47-4f6f-a0dc-44849cae8113 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Removing security group a6ea19d2-cacc-4ce1-9f78-d68328be7c4b from port 2afbe9eb-dc9f-4e11-aca2-d72192f28195 Aug 03 13:06:44.402345 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-5f5be1be-1b47-4f6f-a0dc-44849cae8113 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "POST /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a/action" status: 202 len: 0 microversion: 2.1 time: 0.640588 Aug 03 13:06:44.403537 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 388/774] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Aug 3 13:06:43 2022] POST /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a/action => generated 0 bytes in 643 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 13:06:44.416220 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-42d3277e-6ba0-4dff-96bb-1b11ca98daad req-144c491e-3e02-4af2-b430-6c1f52c81f11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49e06db0-38af-484d-8cc3-40999cc5fb8a", "tag": "2afbe9eb-dc9f-4e11-aca2-d72192f28195"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:06:44.428123 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-42d3277e-6ba0-4dff-96bb-1b11ca98daad req-144c491e-3e02-4af2-b430-6c1f52c81f11 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:44.428963 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-42d3277e-6ba0-4dff-96bb-1b11ca98daad req-144c491e-3e02-4af2-b430-6c1f52c81f11 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:44.442008 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-42d3277e-6ba0-4dff-96bb-1b11ca98daad req-144c491e-3e02-4af2-b430-6c1f52c81f11 service nova] Creating event network-changed:2afbe9eb-dc9f-4e11-aca2-d72192f28195 for instance 49e06db0-38af-484d-8cc3-40999cc5fb8a on hv-cinder-85083 Aug 03 13:06:44.449491 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-42d3277e-6ba0-4dff-96bb-1b11ca98daad req-144c491e-3e02-4af2-b430-6c1f52c81f11 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037169 Aug 03 13:06:44.450551 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 387/775] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:06:44.589329 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-f6a4457a-6e45-4b83-8377-d02aaf1ab607 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:44.590414 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-f6a4457a-6e45-4b83-8377-d02aaf1ab607 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:44.597211 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f6a4457a-6e45-4b83-8377-d02aaf1ab607 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:44.597878 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f6a4457a-6e45-4b83-8377-d02aaf1ab607 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:44.598873 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f6a4457a-6e45-4b83-8377-d02aaf1ab607 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:44.599462 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f6a4457a-6e45-4b83-8377-d02aaf1ab607 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:44.616644 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-f6a4457a-6e45-4b83-8377-d02aaf1ab607 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] HTTP exception thrown: Instance 8097a062-4988-48d8-b95f-404fdf23d14a could not be found. Aug 03 13:06:44.616644 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-f6a4457a-6e45-4b83-8377-d02aaf1ab607 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Request method failure captured: Aug 03 13:06:44.616644 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a HTTP/1.1 Aug 03 13:06:44.616644 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 13:06:44.616644 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 13:06:44.616644 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 13:06:44.616644 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 0 Aug 03 13:06:44.616644 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 13:06:44.616644 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 13:06:44.616644 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 13:06:44.616644 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 13:06:44.616644 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nE7DMH7_yawRG_EFqNprJ7tBLEAekyvd1TBnPLfkLY5FE_9FrSgGLljSycXdPTf3Im9G-ykq7spGFlIg47_VU_2Fobyvwk0dbllyHhXgHfuZGQytAsHHqjzEzu1SvE5rruA2LuPS1Zi7AyBd0EQ49IEVy0pbvx8Z15H7rrkhk-6aqQ Aug 03 13:06:44.616644 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 13:06:44.616644 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 13:06:44.616644 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 13:06:44.616644 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 13:06:44.616644 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 13:06:44.616644 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 13:06:44.616644 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: 23cfcb8de5e448b8af185376a035263b Aug 03 13:06:44.616644 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:06:44.616644 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 13:06:44.616644 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 13:06:44.618040 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_23cfcb8de5e448b8af185376a035263b", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:06:44.618040 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:06:44.618040 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: 23cfcb8de5e448b8af185376a035263b Aug 03 13:06:44.618040 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:06:44.618040 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-AttachVolumeNegativeTest-1034317644-project Aug 03 13:06:44.618040 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 13:06:44.618040 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 13:06:44.618040 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: 36693fa42a7b41279c8d8c59ecafb243 Aug 03 13:06:44.618040 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-AttachVolumeNegativeTest-1034317644-project Aug 03 13:06:44.618040 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: > Aug 03 13:06:44.618040 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Instance 8097a062-4988-48d8-b95f-404fdf23d14a could not be found. Aug 03 13:06:44.618040 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'id': '8097a062-4988-48d8-b95f-404fdf23d14a'} Aug 03 13:06:44.618845 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:06:44.618845 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:06:44.618845 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:06:44.618845 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:06:44.618845 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:06:44.618845 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:06:44.618845 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:06:44.618845 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:06:44.618845 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:06:44.618845 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:06:44.618845 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8097a062-4988-48d8-b95f-404fdf23d14a could not be found. Aug 03 13:06:44.618845 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:06:44.618845 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:06:44.618845 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:06:44.618845 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:06:44.618845 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:06:44.618845 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:06:44.618845 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:06:44.618845 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:06:44.618845 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:06:44.620016 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:06:44.620016 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:06:44.620016 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:06:44.620016 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:06:44.620016 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:06:44.620016 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:06:44.620016 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:06:44.620016 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8097a062-4988-48d8-b95f-404fdf23d14a could not be found. Aug 03 13:06:44.620016 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:06:44.620016 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:06:44.620016 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:06:44.620016 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:06:44.620016 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:06:44.620016 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:06:44.620016 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:06:44.620016 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:06:44.620016 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8097a062-4988-48d8-b95f-404fdf23d14a could not be found. Aug 03 13:06:44.620016 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:06:44.621093 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-f6a4457a-6e45-4b83-8377-d02aaf1ab607 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Returning 404 to user: Instance 8097a062-4988-48d8-b95f-404fdf23d14a could not be found. {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:06:44.621093 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-f6a4457a-6e45-4b83-8377-d02aaf1ab607 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 404 len: 111 microversion: 2.1 time: 0.032884 Aug 03 13:06:44.621093 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 389/776] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:44 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:06:44.628658 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-f3a4734a-7dcc-4ed0-a18a-25d23bb95937 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '.version_select at 0x7fe6d80ddc10>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:44.722311 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-f3a4734a-7dcc-4ed0-a18a-25d23bb95937 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-488394907" status: 202 len: 0 microversion: 2.1 time: 0.098279 Aug 03 13:06:44.725467 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 388/777] 10.222.0.64 () {58 vars in 1218 bytes} [Wed Aug 3 13:06:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-488394907 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 13:06:45.546359 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-4c440ace-613a-4b9d-99d9-6a30d8ce0117 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Action: 'create', calling method: .version_select at 0x7fe6d81b59d0>, body: {"keypair": {"name": "tempest-keypair-102923756", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHicx2xbbdYuW+nH+cpmu3LzfuZj2MLfxdBengNW7EXPx5oXubJE22no5IyB6YZzZar5DnhwWEhV80i7Sk2euiUEEX/uIbXa3jz7WaFsiVPndxjJTInDYWP1yuib7XieaA=="}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:06:45.563030 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-4c440ace-613a-4b9d-99d9-6a30d8ce0117 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Getting quotas for project 23cfcb8de5e448b8af185376a035263b. Resources: {'key_pairs'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 13:06:45.567206 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-4c440ace-613a-4b9d-99d9-6a30d8ce0117 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Getting quotas for user 36693fa42a7b41279c8d8c59ecafb243 and project 23cfcb8de5e448b8af185376a035263b. Resources: {'key_pairs'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 13:06:45.663107 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-4c440ace-613a-4b9d-99d9-6a30d8ce0117 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.120738 Aug 03 13:06:45.663709 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 390/778] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Aug 3 13:06:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:06:45.940974 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-5efe7ca6-67e0-42f1-be2f-437195e5f9cd tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:45.942411 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-5efe7ca6-67e0-42f1-be2f-437195e5f9cd tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:45.945022 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-cf0b7c29-1b0c-4b90-bf30-06b1e8be7d4f req-3f4ef9f1-86ae-48cb-a924-1db3ca8365f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49e06db0-38af-484d-8cc3-40999cc5fb8a", "tag": "2afbe9eb-dc9f-4e11-aca2-d72192f28195"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:06:45.951200 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5efe7ca6-67e0-42f1-be2f-437195e5f9cd tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:45.951769 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5efe7ca6-67e0-42f1-be2f-437195e5f9cd tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:45.952765 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5efe7ca6-67e0-42f1-be2f-437195e5f9cd tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:45.953533 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5efe7ca6-67e0-42f1-be2f-437195e5f9cd tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:45.962600 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-cf0b7c29-1b0c-4b90-bf30-06b1e8be7d4f req-3f4ef9f1-86ae-48cb-a924-1db3ca8365f0 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:45.963056 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-cf0b7c29-1b0c-4b90-bf30-06b1e8be7d4f req-3f4ef9f1-86ae-48cb-a924-1db3ca8365f0 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:45.981695 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-cf0b7c29-1b0c-4b90-bf30-06b1e8be7d4f req-3f4ef9f1-86ae-48cb-a924-1db3ca8365f0 service nova] Creating event network-changed:2afbe9eb-dc9f-4e11-aca2-d72192f28195 for instance 49e06db0-38af-484d-8cc3-40999cc5fb8a on hv-cinder-85083 Aug 03 13:06:45.998709 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-cf0b7c29-1b0c-4b90-bf30-06b1e8be7d4f req-3f4ef9f1-86ae-48cb-a924-1db3ca8365f0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055444 Aug 03 13:06:45.999574 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 391/779] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:06:46.052025 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-5efe7ca6-67e0-42f1-be2f-437195e5f9cd tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lazy-loading 'services' on Instance uuid 49e06db0-38af-484d-8cc3-40999cc5fb8a {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:06:46.262343 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-5efe7ca6-67e0-42f1-be2f-437195e5f9cd tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "DELETE /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a/os-volume_attachments/6e3bce0f-47ac-45f8-b840-9a44a9486f0d" status: 202 len: 0 microversion: 2.1 time: 0.326048 Aug 03 13:06:46.263091 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 389/780] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Aug 3 13:06:45 2022] DELETE /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a/os-volume_attachments/6e3bce0f-47ac-45f8-b840-9a44a9486f0d => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 13:06:46.273983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-6fdc307b-8a07-40be-8e03-b70b01aafb7f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:46.277261 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-6fdc307b-8a07-40be-8e03-b70b01aafb7f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:46.288214 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6fdc307b-8a07-40be-8e03-b70b01aafb7f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:46.293018 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6fdc307b-8a07-40be-8e03-b70b01aafb7f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:46.293018 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6fdc307b-8a07-40be-8e03-b70b01aafb7f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:46.293018 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6fdc307b-8a07-40be-8e03-b70b01aafb7f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:46.327797 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-6fdc307b-8a07-40be-8e03-b70b01aafb7f tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059978 Aug 03 13:06:46.328364 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 392/781] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 3 13:06:46 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:06:47.341038 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-306061ef-2292-4f40-944e-5885d023b27c tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:47.343419 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-306061ef-2292-4f40-944e-5885d023b27c tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:47.350359 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-306061ef-2292-4f40-944e-5885d023b27c tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:47.350832 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-306061ef-2292-4f40-944e-5885d023b27c tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:47.351607 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-306061ef-2292-4f40-944e-5885d023b27c tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:47.352045 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-306061ef-2292-4f40-944e-5885d023b27c tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:47.384080 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-306061ef-2292-4f40-944e-5885d023b27c tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047314 Aug 03 13:06:47.389780 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 390/782] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 3 13:06:47 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:06:48.218644 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-0228ea0f-0a4b-4b88-94c5-8fbabf42e8e0 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2002542323", "imageRef": "c0aabcc0-d4af-4f0e-b8a5-d140344fce1f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "62a2a8c1-4047-4249-9eca-1b469b6efbc6"}], "security_groups": [{"name": "tempest-securitygroup--2060123319"}], "key_name": "tempest-keypair-102923756", "user_data": "}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:06:48.320091 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.network.neutron [None req-0228ea0f-0a4b-4b88-94c5-8fbabf42e8e0 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] validate_networks() for [('62a2a8c1-4047-4249-9eca-1b469b6efbc6', None, None, None, None, None)] {{(pid=119409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 13:06:48.397073 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-f5dd3f99-9605-4fc5-85cd-74d105c8f2db tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:48.399139 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-f5dd3f99-9605-4fc5-85cd-74d105c8f2db tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:48.405628 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f5dd3f99-9605-4fc5-85cd-74d105c8f2db tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:48.406080 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f5dd3f99-9605-4fc5-85cd-74d105c8f2db tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:48.406872 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f5dd3f99-9605-4fc5-85cd-74d105c8f2db tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:48.407310 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f5dd3f99-9605-4fc5-85cd-74d105c8f2db tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:48.436335 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-f5dd3f99-9605-4fc5-85cd-74d105c8f2db tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043328 Aug 03 13:06:48.436906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 391/783] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 3 13:06:48 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 13:06:48.446689 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-57da7c70-292c-4aa6-948a-c8983ca343d6 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:48.447286 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-57da7c70-292c-4aa6-948a-c8983ca343d6 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:48.453370 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-57da7c70-292c-4aa6-948a-c8983ca343d6 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:48.453823 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-57da7c70-292c-4aa6-948a-c8983ca343d6 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:48.454590 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-57da7c70-292c-4aa6-948a-c8983ca343d6 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:48.455059 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-57da7c70-292c-4aa6-948a-c8983ca343d6 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:48.459084 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:06:48.531744 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.wsgi [None req-57da7c70-292c-4aa6-948a-c8983ca343d6 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] HTTP exception thrown: Instance 49e06db0-38af-484d-8cc3-40999cc5fb8a is not attached to volume 6e3bce0f-47ac-45f8-b840-9a44a9486f0d Aug 03 13:06:48.548567 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-57da7c70-292c-4aa6-948a-c8983ca343d6 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Request method failure captured: Aug 03 13:06:48.548567 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: request: DELETE /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a/os-volume_attachments/6e3bce0f-47ac-45f8-b840-9a44a9486f0d HTTP/1.1 Aug 03 13:06:48.548567 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept: application/json Aug 03 13:06:48.548567 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept-Encoding: identity Aug 03 13:06:48.548567 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Connection: close Aug 03 13:06:48.548567 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Length: 0 Aug 03 13:06:48.548567 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Type: application/json Aug 03 13:06:48.548567 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Host: 10.222.0.64 Aug 03 13:06:48.548567 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Openstack-System-Scope: None Aug 03 13:06:48.548567 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: User-Agent: python-urllib3/1.26.10 Aug 03 13:06:48.548567 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Auth-Token: gAAAAABi6nF9YvoefWn4W3Zz1-7YH0nJq7nvhz_atQm1ks93J6x93HdNoN49zaZIERr8Sgxu4KtVtsGvb2lZJ1GdDmlze3_7w5eu3b8RWHLseKvGM1Ve4ShU8673bs8Ifi0cJhz5jLBjm_WeXj5rnrXCpXUjpY64OOdqeP8d2O7tyXgLow2YrHg Aug 03 13:06:48.548567 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Id: None Aug 03 13:06:48.548567 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Name: None Aug 03 13:06:48.548567 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Identity-Status: Confirmed Aug 03 13:06:48.548567 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Is-Admin-Project: True Aug 03 13:06:48.548567 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Id: default Aug 03 13:06:48.548567 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Name: Default Aug 03 13:06:48.548567 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Id: e62db2c6c7d846ff807ac67c8d8d715e Aug 03 13:06:48.548567 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Name: tempest-TestMinimumBasicScenario-7748171 Aug 03 13:06:48.548567 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Role: member,reader Aug 03 13:06:48.548567 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Roles: member,reader Aug 03 13:06:48.550258 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e62db2c6c7d846ff807ac67c8d8d715e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e62db2c6c7d846ff807ac67c8d8d715e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e62db2c6c7d846ff807ac67c8d8d715e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e62db2c6c7d846ff807ac67c8d8d715e", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:06:48.550258 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant: tempest-TestMinimumBasicScenario-7748171 Aug 03 13:06:48.550258 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Id: e62db2c6c7d846ff807ac67c8d8d715e Aug 03 13:06:48.550258 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Name: tempest-TestMinimumBasicScenario-7748171 Aug 03 13:06:48.550258 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User: tempest-TestMinimumBasicScenario-7748171-project Aug 03 13:06:48.550258 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Id: default Aug 03 13:06:48.550258 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Name: Default Aug 03 13:06:48.550258 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Id: 8ab708da71f04d2ab83f3f438a8d49d0 Aug 03 13:06:48.550258 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Name: tempest-TestMinimumBasicScenario-7748171-project Aug 03 13:06:48.550258 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: method: > Aug 03 13:06:48.550258 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: exception: Instance 49e06db0-38af-484d-8cc3-40999cc5fb8a is not attached to volume 6e3bce0f-47ac-45f8-b840-9a44a9486f0d Aug 03 13:06:48.551203 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: action_args: {'server_id': '49e06db0-38af-484d-8cc3-40999cc5fb8a', 'id': '6e3bce0f-47ac-45f8-b840-9a44a9486f0d'} Aug 03 13:06:48.551203 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:06:48.551203 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:06:48.551203 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 03 13:06:48.551203 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 03 13:06:48.551203 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 13:06:48.551203 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 13:06:48.551203 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 03 13:06:48.551203 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 03 13:06:48.551203 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6e3bce0f-47ac-45f8-b840-9a44a9486f0d. Aug 03 13:06:48.551203 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:06:48.551203 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:06:48.551203 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:06:48.551203 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:06:48.551203 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:06:48.551203 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:06:48.551203 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:06:48.551203 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:06:48.551203 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:06:48.552738 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:06:48.552738 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 03 13:06:48.552738 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 13:06:48.552738 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49e06db0-38af-484d-8cc3-40999cc5fb8a is not attached to volume 6e3bce0f-47ac-45f8-b840-9a44a9486f0d Aug 03 13:06:48.552738 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:06:48.552738 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:06:48.552738 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:06:48.552738 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:06:48.552738 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:06:48.552738 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:06:48.552738 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:06:48.552738 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:06:48.552738 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49e06db0-38af-484d-8cc3-40999cc5fb8a is not attached to volume 6e3bce0f-47ac-45f8-b840-9a44a9486f0d Aug 03 13:06:48.552738 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:06:48.552738 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-57da7c70-292c-4aa6-948a-c8983ca343d6 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Returning 404 to user: Instance 49e06db0-38af-484d-8cc3-40999cc5fb8a is not attached to volume 6e3bce0f-47ac-45f8-b840-9a44a9486f0d {{(pid=119410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:06:48.553901 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-57da7c70-292c-4aa6-948a-c8983ca343d6 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "DELETE /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a/os-volume_attachments/6e3bce0f-47ac-45f8-b840-9a44a9486f0d" status: 404 len: 154 microversion: 2.1 time: 0.107163 Aug 03 13:06:48.553901 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 392/784] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Aug 3 13:06:48 2022] DELETE /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a/os-volume_attachments/6e3bce0f-47ac-45f8-b840-9a44a9486f0d => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 13:06:48.698579 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-0228ea0f-0a4b-4b88-94c5-8fbabf42e8e0 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Flavor limits 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 13:06:48.699027 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-0228ea0f-0a4b-4b88-94c5-8fbabf42e8e0 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Image limits 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 13:06:48.699528 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-0228ea0f-0a4b-4b88-94c5-8fbabf42e8e0 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Flavor pref 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 13:06:48.699932 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-0228ea0f-0a4b-4b88-94c5-8fbabf42e8e0 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Image pref 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 13:06:48.700338 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-0228ea0f-0a4b-4b88-94c5-8fbabf42e8e0 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 13:06:48.709220 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0228ea0f-0a4b-4b88-94c5-8fbabf42e8e0 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:48.709683 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0228ea0f-0a4b-4b88-94c5-8fbabf42e8e0 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:48.710474 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0228ea0f-0a4b-4b88-94c5-8fbabf42e8e0 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:48.710949 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0228ea0f-0a4b-4b88-94c5-8fbabf42e8e0 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:48.728223 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-0228ea0f-0a4b-4b88-94c5-8fbabf42e8e0 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Getting quotas for project 23cfcb8de5e448b8af185376a035263b. Resources: {'instances', 'ram', 'cores'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 13:06:48.732227 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-0228ea0f-0a4b-4b88-94c5-8fbabf42e8e0 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Getting quotas for user 36693fa42a7b41279c8d8c59ecafb243 and project 23cfcb8de5e448b8af185376a035263b. Resources: {'instances', 'ram', 'cores'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 13:06:48.743508 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-0228ea0f-0a4b-4b88-94c5-8fbabf42e8e0 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Going to run 1 instances... {{(pid=119409) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 13:06:48.746314 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-0228ea0f-0a4b-4b88-94c5-8fbabf42e8e0 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0aabcc0-d4af-4f0e-b8a5-d140344fce1f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 13:06:48.869367 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-0228ea0f-0a4b-4b88-94c5-8fbabf42e8e0 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.654929 Aug 03 13:06:48.870500 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 393/785] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 3 13:06:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 13:06:48.881959 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1ab4ea24-6f95-40a1-9597-1a1bcc7ed9ff tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:48.888763 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-1ab4ea24-6f95-40a1-9597-1a1bcc7ed9ff tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:48.940152 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-1ab4ea24-6f95-40a1-9597-1a1bcc7ed9ff tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:48.947154 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-1ab4ea24-6f95-40a1-9597-1a1bcc7ed9ff tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1" status: 200 len: 1241 microversion: 2.1 time: 0.069220 Aug 03 13:06:48.947778 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 393/786] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:48 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:49.796811 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-444dd359-f03b-4ed2-bbd3-9f968057b2d9 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:49.797308 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-444dd359-f03b-4ed2-bbd3-9f968057b2d9 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:49.804159 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-444dd359-f03b-4ed2-bbd3-9f968057b2d9 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:49.804681 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-444dd359-f03b-4ed2-bbd3-9f968057b2d9 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:49.805448 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-444dd359-f03b-4ed2-bbd3-9f968057b2d9 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:49.805878 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-444dd359-f03b-4ed2-bbd3-9f968057b2d9 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:49.830151 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-444dd359-f03b-4ed2-bbd3-9f968057b2d9 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Going to try to terminate instance {{(pid=119409) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 13:06:49.970050 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-c5e6e8b2-e1ba-45ed-be21-dd8b72d3f216 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:49.970616 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-c5e6e8b2-e1ba-45ed-be21-dd8b72d3f216 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:49.978159 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c5e6e8b2-e1ba-45ed-be21-dd8b72d3f216 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:49.978653 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c5e6e8b2-e1ba-45ed-be21-dd8b72d3f216 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:49.979674 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c5e6e8b2-e1ba-45ed-be21-dd8b72d3f216 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:49.980092 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c5e6e8b2-e1ba-45ed-be21-dd8b72d3f216 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:50.044799 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c5e6e8b2-e1ba-45ed-be21-dd8b72d3f216 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:50.052305 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-c5e6e8b2-e1ba-45ed-be21-dd8b72d3f216 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1" status: 200 len: 1245 microversion: 2.1 time: 0.086127 Aug 03 13:06:50.052869 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 394/787] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:49 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:06:50.103679 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-444dd359-f03b-4ed2-bbd3-9f968057b2d9 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "DELETE /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 204 len: 0 microversion: 2.1 time: 0.311054 Aug 03 13:06:50.104311 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 394/788] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 3 13:06:49 2022] DELETE /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 13:06:50.112444 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-9873a70a-f8cf-49d0-823b-43da76adaa1b tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:50.113069 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-9873a70a-f8cf-49d0-823b-43da76adaa1b tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:50.119192 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9873a70a-f8cf-49d0-823b-43da76adaa1b tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:50.120174 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9873a70a-f8cf-49d0-823b-43da76adaa1b tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:50.120931 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9873a70a-f8cf-49d0-823b-43da76adaa1b tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:50.121536 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9873a70a-f8cf-49d0-823b-43da76adaa1b tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:50.251799 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-9873a70a-f8cf-49d0-823b-43da76adaa1b tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:50.259181 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-9873a70a-f8cf-49d0-823b-43da76adaa1b tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1555 microversion: 2.1 time: 0.150677 Aug 03 13:06:50.259742 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 395/789] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:50 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:51.073732 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-dbff507e-e080-42ae-8c79-50a94f298074 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:51.074560 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-dbff507e-e080-42ae-8c79-50a94f298074 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:51.082566 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-dbff507e-e080-42ae-8c79-50a94f298074 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:51.083040 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-dbff507e-e080-42ae-8c79-50a94f298074 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:51.083850 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-dbff507e-e080-42ae-8c79-50a94f298074 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:51.084276 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-dbff507e-e080-42ae-8c79-50a94f298074 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:51.146006 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-dbff507e-e080-42ae-8c79-50a94f298074 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:51.154174 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-dbff507e-e080-42ae-8c79-50a94f298074 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1" status: 200 len: 1293 microversion: 2.1 time: 0.084691 Aug 03 13:06:51.154727 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 395/790] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:51 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:51.280480 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-8537081c-1d25-4b8a-ac4e-558130223517 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:51.281014 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-8537081c-1d25-4b8a-ac4e-558130223517 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:51.287816 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8537081c-1d25-4b8a-ac4e-558130223517 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:51.288269 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8537081c-1d25-4b8a-ac4e-558130223517 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:51.289029 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8537081c-1d25-4b8a-ac4e-558130223517 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:51.289464 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8537081c-1d25-4b8a-ac4e-558130223517 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:51.420120 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-8537081c-1d25-4b8a-ac4e-558130223517 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:51.427629 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-8537081c-1d25-4b8a-ac4e-558130223517 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1555 microversion: 2.1 time: 0.151745 Aug 03 13:06:51.429012 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 396/791] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:51 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:52.175679 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d93d3a44-8da5-41fe-86da-3bf7eb064647 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:52.176295 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-d93d3a44-8da5-41fe-86da-3bf7eb064647 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:52.183522 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d93d3a44-8da5-41fe-86da-3bf7eb064647 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:52.183973 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d93d3a44-8da5-41fe-86da-3bf7eb064647 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:52.184735 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d93d3a44-8da5-41fe-86da-3bf7eb064647 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:52.185173 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d93d3a44-8da5-41fe-86da-3bf7eb064647 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:52.248276 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-d93d3a44-8da5-41fe-86da-3bf7eb064647 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:52.255713 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-d93d3a44-8da5-41fe-86da-3bf7eb064647 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1" status: 200 len: 1293 microversion: 2.1 time: 0.083838 Aug 03 13:06:52.256469 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 396/792] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:52 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:52.448443 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-b4d17133-f0b2-4c82-b923-64e2c1a2f9a4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:52.449066 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-b4d17133-f0b2-4c82-b923-64e2c1a2f9a4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:52.455703 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b4d17133-f0b2-4c82-b923-64e2c1a2f9a4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:52.456144 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b4d17133-f0b2-4c82-b923-64e2c1a2f9a4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:52.456901 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b4d17133-f0b2-4c82-b923-64e2c1a2f9a4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:52.457328 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b4d17133-f0b2-4c82-b923-64e2c1a2f9a4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:52.595096 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-b4d17133-f0b2-4c82-b923-64e2c1a2f9a4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:52.603315 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-b4d17133-f0b2-4c82-b923-64e2c1a2f9a4 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1555 microversion: 2.1 time: 0.158701 Aug 03 13:06:52.603937 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 397/793] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:52 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:53.260751 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-c9449082-2a07-4809-8449-986315556ca6 req-3eca3068-f085-4457-b6ad-1d950ba113c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49e06db0-38af-484d-8cc3-40999cc5fb8a", "name": "network-vif-deleted", "tag": "2afbe9eb-dc9f-4e11-aca2-d72192f28195"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:06:53.270312 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-c9449082-2a07-4809-8449-986315556ca6 req-3eca3068-f085-4457-b6ad-1d950ba113c6 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:53.270797 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-c9449082-2a07-4809-8449-986315556ca6 req-3eca3068-f085-4457-b6ad-1d950ba113c6 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:53.277237 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-aaa5117c-b446-43f8-acf6-ec231c148ada tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:53.278237 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-aaa5117c-b446-43f8-acf6-ec231c148ada tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:53.282711 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-c9449082-2a07-4809-8449-986315556ca6 req-3eca3068-f085-4457-b6ad-1d950ba113c6 service nova] Creating event network-vif-deleted:2afbe9eb-dc9f-4e11-aca2-d72192f28195 for instance 49e06db0-38af-484d-8cc3-40999cc5fb8a on hv-cinder-85083 Aug 03 13:06:53.285522 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-aaa5117c-b446-43f8-acf6-ec231c148ada tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:53.287946 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-aaa5117c-b446-43f8-acf6-ec231c148ada tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:53.288442 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-aaa5117c-b446-43f8-acf6-ec231c148ada tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:53.288708 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-c9449082-2a07-4809-8449-986315556ca6 req-3eca3068-f085-4457-b6ad-1d950ba113c6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032501 Aug 03 13:06:53.289175 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-aaa5117c-b446-43f8-acf6-ec231c148ada tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:53.289484 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 397/794] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:06:53.355072 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-aaa5117c-b446-43f8-acf6-ec231c148ada tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:53.362843 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-aaa5117c-b446-43f8-acf6-ec231c148ada tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1" status: 200 len: 1299 microversion: 2.1 time: 0.090276 Aug 03 13:06:53.363404 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 398/795] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:53 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 => generated 1299 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:06:53.625101 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-9a536999-bc24-42bd-80a3-6e4b59d3c753 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:53.625822 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-9a536999-bc24-42bd-80a3-6e4b59d3c753 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:53.633123 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9a536999-bc24-42bd-80a3-6e4b59d3c753 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:53.633565 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9a536999-bc24-42bd-80a3-6e4b59d3c753 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:53.634338 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9a536999-bc24-42bd-80a3-6e4b59d3c753 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:53.634810 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9a536999-bc24-42bd-80a3-6e4b59d3c753 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:53.679819 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9a536999-bc24-42bd-80a3-6e4b59d3c753 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:53.680380 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9a536999-bc24-42bd-80a3-6e4b59d3c753 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:53.680889 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.objects.instance [None req-9a536999-bc24-42bd-80a3-6e4b59d3c753 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lazy-loading 'fault' on Instance uuid 49e06db0-38af-484d-8cc3-40999cc5fb8a {{(pid=119409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:06:53.735940 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-9a536999-bc24-42bd-80a3-6e4b59d3c753 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab708da71f04d2ab83f3f438a8d49d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62db2c6c7d846ff807ac67c8d8d715e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:53.739743 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:06:53.744795 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-9a536999-bc24-42bd-80a3-6e4b59d3c753 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 200 len: 1349 microversion: 2.1 time: 0.123771 Aug 03 13:06:53.745376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 398/796] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:53 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 1349 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:54.384562 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-81414474-d2c7-45b7-9813-77be832227a5 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:54.385188 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-81414474-d2c7-45b7-9813-77be832227a5 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:54.391774 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-81414474-d2c7-45b7-9813-77be832227a5 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:54.392214 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-81414474-d2c7-45b7-9813-77be832227a5 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:54.392978 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-81414474-d2c7-45b7-9813-77be832227a5 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:54.393407 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-81414474-d2c7-45b7-9813-77be832227a5 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:54.526479 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-81414474-d2c7-45b7-9813-77be832227a5 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:54.535217 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-81414474-d2c7-45b7-9813-77be832227a5 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1" status: 200 len: 1367 microversion: 2.1 time: 0.154606 Aug 03 13:06:54.535851 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 399/797] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:54 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:54.765738 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-be8cbdbc-6937-4159-9e6b-1e2fc60f2222 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:54.766375 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-be8cbdbc-6937-4159-9e6b-1e2fc60f2222 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] [instance: 49e06db0-38af-484d-8cc3-40999cc5fb8a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:54.773533 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-be8cbdbc-6937-4159-9e6b-1e2fc60f2222 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:54.773978 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-be8cbdbc-6937-4159-9e6b-1e2fc60f2222 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:54.774760 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-be8cbdbc-6937-4159-9e6b-1e2fc60f2222 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:54.775194 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-be8cbdbc-6937-4159-9e6b-1e2fc60f2222 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:54.790237 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-be8cbdbc-6937-4159-9e6b-1e2fc60f2222 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] HTTP exception thrown: Instance 49e06db0-38af-484d-8cc3-40999cc5fb8a could not be found. Aug 03 13:06:54.792572 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-be8cbdbc-6937-4159-9e6b-1e2fc60f2222 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Request method failure captured: Aug 03 13:06:54.792572 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a HTTP/1.1 Aug 03 13:06:54.792572 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 13:06:54.792572 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 13:06:54.792572 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 13:06:54.792572 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 0 Aug 03 13:06:54.792572 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 13:06:54.792572 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 13:06:54.792572 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 13:06:54.792572 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 13:06:54.792572 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nF9YvoefWn4W3Zz1-7YH0nJq7nvhz_atQm1ks93J6x93HdNoN49zaZIERr8Sgxu4KtVtsGvb2lZJ1GdDmlze3_7w5eu3b8RWHLseKvGM1Ve4ShU8673bs8Ifi0cJhz5jLBjm_WeXj5rnrXCpXUjpY64OOdqeP8d2O7tyXgLow2YrHg Aug 03 13:06:54.792572 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 13:06:54.792572 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 13:06:54.792572 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 13:06:54.792572 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 13:06:54.792572 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 13:06:54.792572 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 13:06:54.792572 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: e62db2c6c7d846ff807ac67c8d8d715e Aug 03 13:06:54.792572 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-TestMinimumBasicScenario-7748171 Aug 03 13:06:54.792572 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 13:06:54.792572 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 13:06:54.798452 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e62db2c6c7d846ff807ac67c8d8d715e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e62db2c6c7d846ff807ac67c8d8d715e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e62db2c6c7d846ff807ac67c8d8d715e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e62db2c6c7d846ff807ac67c8d8d715e", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:06:54.798452 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-TestMinimumBasicScenario-7748171 Aug 03 13:06:54.798452 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: e62db2c6c7d846ff807ac67c8d8d715e Aug 03 13:06:54.798452 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-TestMinimumBasicScenario-7748171 Aug 03 13:06:54.798452 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-TestMinimumBasicScenario-7748171-project Aug 03 13:06:54.798452 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 13:06:54.798452 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 13:06:54.798452 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: 8ab708da71f04d2ab83f3f438a8d49d0 Aug 03 13:06:54.798452 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-TestMinimumBasicScenario-7748171-project Aug 03 13:06:54.798452 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: > Aug 03 13:06:54.798452 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Instance 49e06db0-38af-484d-8cc3-40999cc5fb8a could not be found. Aug 03 13:06:54.798452 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'id': '49e06db0-38af-484d-8cc3-40999cc5fb8a'} Aug 03 13:06:54.801023 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:06:54.801023 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:06:54.801023 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:06:54.801023 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:06:54.801023 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:06:54.801023 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:06:54.801023 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:06:54.801023 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:06:54.801023 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:06:54.801023 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:06:54.801023 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49e06db0-38af-484d-8cc3-40999cc5fb8a could not be found. Aug 03 13:06:54.801023 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:06:54.801023 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:06:54.801023 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:06:54.801023 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:06:54.801023 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:06:54.801023 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:06:54.801023 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:06:54.801023 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:06:54.801023 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:06:54.802481 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:06:54.802481 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:06:54.802481 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:06:54.802481 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:06:54.802481 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:06:54.802481 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:06:54.802481 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:06:54.802481 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49e06db0-38af-484d-8cc3-40999cc5fb8a could not be found. Aug 03 13:06:54.802481 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:06:54.802481 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:06:54.802481 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:06:54.802481 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:06:54.802481 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:06:54.802481 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:06:54.802481 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:06:54.802481 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:06:54.802481 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49e06db0-38af-484d-8cc3-40999cc5fb8a could not be found. Aug 03 13:06:54.802481 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:06:54.803872 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-be8cbdbc-6937-4159-9e6b-1e2fc60f2222 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Returning 404 to user: Instance 49e06db0-38af-484d-8cc3-40999cc5fb8a could not be found. {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:06:54.803872 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-be8cbdbc-6937-4159-9e6b-1e2fc60f2222 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a" status: 404 len: 111 microversion: 2.1 time: 0.032526 Aug 03 13:06:54.803872 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 399/798] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:54 2022] GET /compute/v2.1/servers/49e06db0-38af-484d-8cc3-40999cc5fb8a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:06:54.810153 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-b49d3d55-c5e3-4932-9fa6-838f4cd17784 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] Calling method '.version_select at 0x7fe6cbfb2310>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:54.897450 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-b49d3d55-c5e3-4932-9fa6-838f4cd17784 tempest-TestMinimumBasicScenario-7748171 tempest-TestMinimumBasicScenario-7748171-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2027171876" status: 202 len: 0 microversion: 2.1 time: 0.091220 Aug 03 13:06:54.898041 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 400/799] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Aug 3 13:06:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2027171876 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 13:06:55.304983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-e0b110ab-59ad-48eb-a202-6849fc123367 req-445fa83d-52f3-4907-9948-5f88ce585166 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdddc591-873f-484c-ac08-022cdfd864c1", "tag": "7f9c7e63-c467-4d5b-b0fa-1fc75725b588"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:06:55.316086 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-e0b110ab-59ad-48eb-a202-6849fc123367 req-445fa83d-52f3-4907-9948-5f88ce585166 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:55.320660 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-e0b110ab-59ad-48eb-a202-6849fc123367 req-445fa83d-52f3-4907-9948-5f88ce585166 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:55.328221 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-e0b110ab-59ad-48eb-a202-6849fc123367 req-445fa83d-52f3-4907-9948-5f88ce585166 service nova] Creating event network-changed:7f9c7e63-c467-4d5b-b0fa-1fc75725b588 for instance fdddc591-873f-484c-ac08-022cdfd864c1 on hv-cinder-85083 Aug 03 13:06:55.333076 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-e0b110ab-59ad-48eb-a202-6849fc123367 req-445fa83d-52f3-4907-9948-5f88ce585166 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031612 Aug 03 13:06:55.333655 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 400/800] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:06:55.555838 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-c2246225-efe4-4024-b29b-eb31b3ffa53f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:55.556455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-c2246225-efe4-4024-b29b-eb31b3ffa53f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:55.563231 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c2246225-efe4-4024-b29b-eb31b3ffa53f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:55.563683 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c2246225-efe4-4024-b29b-eb31b3ffa53f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:55.564560 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c2246225-efe4-4024-b29b-eb31b3ffa53f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:55.565003 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c2246225-efe4-4024-b29b-eb31b3ffa53f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:55.696207 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c2246225-efe4-4024-b29b-eb31b3ffa53f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:55.703675 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-c2246225-efe4-4024-b29b-eb31b3ffa53f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1" status: 200 len: 1367 microversion: 2.1 time: 0.151780 Aug 03 13:06:55.704237 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 401/801] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:55 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:06:56.725880 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-37f35ff8-3015-4c39-a87f-d3885267d07d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:56.726694 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-37f35ff8-3015-4c39-a87f-d3885267d07d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:56.733843 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-37f35ff8-3015-4c39-a87f-d3885267d07d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:56.734283 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-37f35ff8-3015-4c39-a87f-d3885267d07d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:56.735272 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-37f35ff8-3015-4c39-a87f-d3885267d07d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:56.735499 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-37f35ff8-3015-4c39-a87f-d3885267d07d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:56.980911 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-37f35ff8-3015-4c39-a87f-d3885267d07d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:56.988315 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-37f35ff8-3015-4c39-a87f-d3885267d07d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1" status: 200 len: 1367 microversion: 2.1 time: 0.267142 Aug 03 13:06:56.988885 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 401/802] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:56 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:58.008829 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-bbd95380-df36-421e-9eda-ed722a48a891 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:58.009738 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-bbd95380-df36-421e-9eda-ed722a48a891 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:58.018338 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bbd95380-df36-421e-9eda-ed722a48a891 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:58.019342 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bbd95380-df36-421e-9eda-ed722a48a891 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:58.020320 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bbd95380-df36-421e-9eda-ed722a48a891 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:58.020769 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-bbd95380-df36-421e-9eda-ed722a48a891 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:58.165932 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-bbd95380-df36-421e-9eda-ed722a48a891 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:58.173970 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-bbd95380-df36-421e-9eda-ed722a48a891 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1" status: 200 len: 1367 microversion: 2.1 time: 0.169092 Aug 03 13:06:58.174644 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 402/803] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:58 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:06:59.199933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-387a0bcc-3f85-4cfc-a917-82890a9bc9b9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:06:59.200608 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-387a0bcc-3f85-4cfc-a917-82890a9bc9b9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:06:59.203105 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell0:SELECT=2 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:06:59.203986 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell0:SELECT=10 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:06:59.212902 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-387a0bcc-3f85-4cfc-a917-82890a9bc9b9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:59.213358 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-387a0bcc-3f85-4cfc-a917-82890a9bc9b9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:59.214274 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-387a0bcc-3f85-4cfc-a917-82890a9bc9b9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:06:59.214710 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-387a0bcc-3f85-4cfc-a917-82890a9bc9b9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:06:59.441124 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-387a0bcc-3f85-4cfc-a917-82890a9bc9b9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:06:59.449879 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-387a0bcc-3f85-4cfc-a917-82890a9bc9b9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1" status: 200 len: 1367 microversion: 2.1 time: 0.258464 Aug 03 13:06:59.460401 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 402/804] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:06:59 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:07:00.471278 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-7af5ebf5-3b8f-4b80-9b31-c645116f48aa tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:00.471858 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-7af5ebf5-3b8f-4b80-9b31-c645116f48aa tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:00.473699 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=2 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:07:00.479130 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7af5ebf5-3b8f-4b80-9b31-c645116f48aa tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:00.479592 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7af5ebf5-3b8f-4b80-9b31-c645116f48aa tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:00.480359 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7af5ebf5-3b8f-4b80-9b31-c645116f48aa tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:00.480791 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7af5ebf5-3b8f-4b80-9b31-c645116f48aa tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:00.612257 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-7af5ebf5-3b8f-4b80-9b31-c645116f48aa tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:00.619740 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-7af5ebf5-3b8f-4b80-9b31-c645116f48aa tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1" status: 200 len: 1367 microversion: 2.1 time: 0.152406 Aug 03 13:07:00.620802 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 403/805] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:07:00 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:07:00.926460 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-393f8bc1-0f8e-4f45-86c9-9c027732c202 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:00.926460 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-393f8bc1-0f8e-4f45-86c9-9c027732c202 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:00.932699 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-393f8bc1-0f8e-4f45-86c9-9c027732c202 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:00.933271 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-393f8bc1-0f8e-4f45-86c9-9c027732c202 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:00.934157 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-393f8bc1-0f8e-4f45-86c9-9c027732c202 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:00.934907 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-393f8bc1-0f8e-4f45-86c9-9c027732c202 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:00.967515 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-393f8bc1-0f8e-4f45-86c9-9c027732c202 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1/os-volume_attachments/8f80487b-d082-419d-aac5-09ca4d6a6d31" status: 200 len: 194 microversion: 2.20 time: 0.046896 Aug 03 13:07:00.968189 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 403/806] 10.222.0.64 () {60 vars in 1454 bytes} [Wed Aug 3 13:07:00 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1/os-volume_attachments/8f80487b-d082-419d-aac5-09ca4d6a6d31 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 13:07:01.049238 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d972bda7-4e0b-4f9c-8eb8-b549115bd192 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:01.049736 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d972bda7-4e0b-4f9c-8eb8-b549115bd192 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:01.055654 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d972bda7-4e0b-4f9c-8eb8-b549115bd192 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:01.058077 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d972bda7-4e0b-4f9c-8eb8-b549115bd192 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:01.058077 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d972bda7-4e0b-4f9c-8eb8-b549115bd192 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:01.058077 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d972bda7-4e0b-4f9c-8eb8-b549115bd192 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:01.139992 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-d972bda7-4e0b-4f9c-8eb8-b549115bd192 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lazy-loading 'services' on Instance uuid 67e92b94-74d5-4161-ab5d-80b10c84bfb1 {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:07:01.478261 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d972bda7-4e0b-4f9c-8eb8-b549115bd192 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "DELETE /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1/os-volume_attachments/8f80487b-d082-419d-aac5-09ca4d6a6d31" status: 202 len: 0 microversion: 2.20 time: 0.432747 Aug 03 13:07:01.479286 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 404/807] 10.222.0.64 () {60 vars in 1457 bytes} [Wed Aug 3 13:07:01 2022] DELETE /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1/os-volume_attachments/8f80487b-d082-419d-aac5-09ca4d6a6d31 => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 13:07:01.489682 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-bc536854-66ab-4c02-9d47-a9cc95b5cab7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:01.492069 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-bc536854-66ab-4c02-9d47-a9cc95b5cab7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:01.498612 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bc536854-66ab-4c02-9d47-a9cc95b5cab7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:01.499142 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bc536854-66ab-4c02-9d47-a9cc95b5cab7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:01.499943 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bc536854-66ab-4c02-9d47-a9cc95b5cab7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:01.500383 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bc536854-66ab-4c02-9d47-a9cc95b5cab7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:01.530193 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-bc536854-66ab-4c02-9d47-a9cc95b5cab7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045850 Aug 03 13:07:01.530778 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 404/808] 10.222.0.64 () {60 vars in 1343 bytes} [Wed Aug 3 13:07:01 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 13:07:01.641594 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-595bac36-fa1e-4a5b-ad82-948764618111 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:01.642421 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-595bac36-fa1e-4a5b-ad82-948764618111 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:01.648659 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-595bac36-fa1e-4a5b-ad82-948764618111 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:01.649107 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-595bac36-fa1e-4a5b-ad82-948764618111 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:01.649867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-595bac36-fa1e-4a5b-ad82-948764618111 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:01.650294 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-595bac36-fa1e-4a5b-ad82-948764618111 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:01.792292 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-595bac36-fa1e-4a5b-ad82-948764618111 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:01.803810 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-595bac36-fa1e-4a5b-ad82-948764618111 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1" status: 200 len: 1367 microversion: 2.1 time: 0.166114 Aug 03 13:07:01.805176 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 405/809] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:07:01 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:07:02.544370 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-27b9fc22-8580-4b8c-90cd-23bc65b9dd34 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:02.547312 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-27b9fc22-8580-4b8c-90cd-23bc65b9dd34 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:02.551800 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:07:02.555496 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-27b9fc22-8580-4b8c-90cd-23bc65b9dd34 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:02.561340 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-27b9fc22-8580-4b8c-90cd-23bc65b9dd34 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:02.561493 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-63d910cb-a86a-46c7-8e26-478dd40f8607 req-bee2b75b-6f62-4464-8169-e7fcaa49ea0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdddc591-873f-484c-ac08-022cdfd864c1", "name": "network-vif-plugged", "status": "completed", "tag": "7f9c7e63-c467-4d5b-b0fa-1fc75725b588"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:07:02.566517 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-27b9fc22-8580-4b8c-90cd-23bc65b9dd34 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:02.567002 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-27b9fc22-8580-4b8c-90cd-23bc65b9dd34 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:02.575841 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:07:02.577744 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-63d910cb-a86a-46c7-8e26-478dd40f8607 req-bee2b75b-6f62-4464-8169-e7fcaa49ea0a service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:02.587545 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-63d910cb-a86a-46c7-8e26-478dd40f8607 req-bee2b75b-6f62-4464-8169-e7fcaa49ea0a service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:02.601203 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-63d910cb-a86a-46c7-8e26-478dd40f8607 req-bee2b75b-6f62-4464-8169-e7fcaa49ea0a service nova] Creating event network-vif-plugged:7f9c7e63-c467-4d5b-b0fa-1fc75725b588 for instance fdddc591-873f-484c-ac08-022cdfd864c1 on hv-cinder-85083 Aug 03 13:07:02.607325 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-63d910cb-a86a-46c7-8e26-478dd40f8607 req-bee2b75b-6f62-4464-8169-e7fcaa49ea0a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049586 Aug 03 13:07:02.607961 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 406/810] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:07:02.612069 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-27b9fc22-8580-4b8c-90cd-23bc65b9dd34 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072934 Aug 03 13:07:02.612788 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 405/811] 10.222.0.64 () {60 vars in 1343 bytes} [Wed Aug 3 13:07:02 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 13:07:02.829494 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-c09cf166-5ab5-44e7-b659-1f725d7c7a76 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:02.830195 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-c09cf166-5ab5-44e7-b659-1f725d7c7a76 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:02.836998 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c09cf166-5ab5-44e7-b659-1f725d7c7a76 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:02.837453 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c09cf166-5ab5-44e7-b659-1f725d7c7a76 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:02.838279 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c09cf166-5ab5-44e7-b659-1f725d7c7a76 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:02.838717 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c09cf166-5ab5-44e7-b659-1f725d7c7a76 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:02.987475 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c09cf166-5ab5-44e7-b659-1f725d7c7a76 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:03.000344 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-c09cf166-5ab5-44e7-b659-1f725d7c7a76 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1" status: 200 len: 1367 microversion: 2.1 time: 0.175278 Aug 03 13:07:03.000933 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 407/812] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:07:02 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:07:03.628043 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-b25118a2-ef02-46d2-a359-e8fb467c2c04 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:03.630349 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-b25118a2-ef02-46d2-a359-e8fb467c2c04 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:03.639110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b25118a2-ef02-46d2-a359-e8fb467c2c04 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:03.639561 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b25118a2-ef02-46d2-a359-e8fb467c2c04 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:03.640446 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b25118a2-ef02-46d2-a359-e8fb467c2c04 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:03.640885 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b25118a2-ef02-46d2-a359-e8fb467c2c04 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:03.672616 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-b25118a2-ef02-46d2-a359-e8fb467c2c04 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050622 Aug 03 13:07:03.678793 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 406/813] 10.222.0.64 () {60 vars in 1343 bytes} [Wed Aug 3 13:07:03 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:07:03.747489 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-14c2862f-b632-45c8-b8b2-73a9854409a7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:03.748102 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-14c2862f-b632-45c8-b8b2-73a9854409a7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:03.754972 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-14c2862f-b632-45c8-b8b2-73a9854409a7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:03.755421 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-14c2862f-b632-45c8-b8b2-73a9854409a7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:03.756188 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-14c2862f-b632-45c8-b8b2-73a9854409a7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:03.756625 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-14c2862f-b632-45c8-b8b2-73a9854409a7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:03.782934 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-14c2862f-b632-45c8-b8b2-73a9854409a7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Going to try to terminate instance {{(pid=119410) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 13:07:04.021505 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-a55e384e-8e44-46fe-ac13-1101583e5489 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:04.022108 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-a55e384e-8e44-46fe-ac13-1101583e5489 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:04.029290 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a55e384e-8e44-46fe-ac13-1101583e5489 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:04.029771 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a55e384e-8e44-46fe-ac13-1101583e5489 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:04.030503 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a55e384e-8e44-46fe-ac13-1101583e5489 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:04.030997 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a55e384e-8e44-46fe-ac13-1101583e5489 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:04.086718 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-14c2862f-b632-45c8-b8b2-73a9854409a7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "DELETE /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 204 len: 0 microversion: 2.20 time: 0.343882 Aug 03 13:07:04.087706 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 408/814] 10.222.0.64 () {60 vars in 1280 bytes} [Wed Aug 3 13:07:03 2022] DELETE /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 13:07:04.097788 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d7edc96e-5a9c-4286-9784-2ab71344e36f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:04.098492 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d7edc96e-5a9c-4286-9784-2ab71344e36f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:04.104843 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d7edc96e-5a9c-4286-9784-2ab71344e36f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:04.105291 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d7edc96e-5a9c-4286-9784-2ab71344e36f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:04.106288 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d7edc96e-5a9c-4286-9784-2ab71344e36f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:04.106726 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d7edc96e-5a9c-4286-9784-2ab71344e36f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:04.111103 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:07:04.315904 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-a55e384e-8e44-46fe-ac13-1101583e5489 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:04.330826 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-a55e384e-8e44-46fe-ac13-1101583e5489 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1" status: 200 len: 1367 microversion: 2.1 time: 0.313064 Aug 03 13:07:04.331489 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 407/815] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:07:04 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 => generated 1367 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:07:04.351074 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d7edc96e-5a9c-4286-9784-2ab71344e36f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:04.359925 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d7edc96e-5a9c-4286-9784-2ab71344e36f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:04.361903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d7edc96e-5a9c-4286-9784-2ab71344e36f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:04.363370 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d7edc96e-5a9c-4286-9784-2ab71344e36f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1724 microversion: 2.20 time: 0.269675 Aug 03 13:07:04.371297 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 409/816] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:07:04 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:07:05.357968 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-7f21b434-4639-4e73-bcc0-23ffe811c746 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:05.358503 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-7f21b434-4639-4e73-bcc0-23ffe811c746 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:05.365088 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7f21b434-4639-4e73-bcc0-23ffe811c746 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:05.365558 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7f21b434-4639-4e73-bcc0-23ffe811c746 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:05.366315 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7f21b434-4639-4e73-bcc0-23ffe811c746 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:05.366771 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7f21b434-4639-4e73-bcc0-23ffe811c746 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:05.389269 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-eb0379e3-6475-4ca8-a884-a63f55b10fb1 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:05.390016 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-eb0379e3-6475-4ca8-a884-a63f55b10fb1 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:05.397495 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-eb0379e3-6475-4ca8-a884-a63f55b10fb1 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:05.398051 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-eb0379e3-6475-4ca8-a884-a63f55b10fb1 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:05.398834 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-eb0379e3-6475-4ca8-a884-a63f55b10fb1 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:05.399268 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-eb0379e3-6475-4ca8-a884-a63f55b10fb1 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:05.567115 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-7f21b434-4639-4e73-bcc0-23ffe811c746 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:05.573779 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-eb0379e3-6475-4ca8-a884-a63f55b10fb1 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:05.581404 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-7f21b434-4639-4e73-bcc0-23ffe811c746 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1" status: 200 len: 1367 microversion: 2.1 time: 0.227624 Aug 03 13:07:05.581979 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 408/817] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:07:05 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:07:05.587100 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-eb0379e3-6475-4ca8-a884-a63f55b10fb1 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:05.588606 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-eb0379e3-6475-4ca8-a884-a63f55b10fb1 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:05.589820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-eb0379e3-6475-4ca8-a884-a63f55b10fb1 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1724 microversion: 2.20 time: 0.205283 Aug 03 13:07:05.590379 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 410/818] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:07:05 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:07:06.606982 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-e2147be2-4e62-42ce-8ea1-1732e28771e8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:06.607669 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-e2147be2-4e62-42ce-8ea1-1732e28771e8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:06.613477 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-db89e83a-884f-4393-b9cb-1d9340950362 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:06.614674 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e2147be2-4e62-42ce-8ea1-1732e28771e8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:06.614916 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-db89e83a-884f-4393-b9cb-1d9340950362 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:06.615160 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e2147be2-4e62-42ce-8ea1-1732e28771e8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:06.615977 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e2147be2-4e62-42ce-8ea1-1732e28771e8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:06.616583 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e2147be2-4e62-42ce-8ea1-1732e28771e8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:06.621193 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-db89e83a-884f-4393-b9cb-1d9340950362 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:06.622101 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-db89e83a-884f-4393-b9cb-1d9340950362 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:06.622422 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-db89e83a-884f-4393-b9cb-1d9340950362 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:06.622881 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-db89e83a-884f-4393-b9cb-1d9340950362 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:06.809928 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-e2147be2-4e62-42ce-8ea1-1732e28771e8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:06.816700 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-db89e83a-884f-4393-b9cb-1d9340950362 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:06.817569 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-e2147be2-4e62-42ce-8ea1-1732e28771e8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1" status: 200 len: 1557 microversion: 2.1 time: 0.216921 Aug 03 13:07:06.818141 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 409/819] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:07:06 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 => generated 1557 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:07:06.825184 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-db89e83a-884f-4393-b9cb-1d9340950362 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:06.826797 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-db89e83a-884f-4393-b9cb-1d9340950362 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:06.828036 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-db89e83a-884f-4393-b9cb-1d9340950362 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1724 microversion: 2.20 time: 0.218402 Aug 03 13:07:06.828620 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 411/820] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:07:06 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:07:06.837743 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-95db0618-7b78-4fcb-854c-1910373f7a62 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:06.838243 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-95db0618-7b78-4fcb-854c-1910373f7a62 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:06.844804 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-95db0618-7b78-4fcb-854c-1910373f7a62 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:06.845258 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-95db0618-7b78-4fcb-854c-1910373f7a62 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:06.846021 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-95db0618-7b78-4fcb-854c-1910373f7a62 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:06.846458 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-95db0618-7b78-4fcb-854c-1910373f7a62 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:06.925574 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-95db0618-7b78-4fcb-854c-1910373f7a62 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091553 Aug 03 13:07:06.926248 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 410/821] 10.222.0.64 () {58 vars in 1275 bytes} [Wed Aug 3 13:07:06 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:07:07.738966 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-16ea1b18-ec28-4b01-bd2c-222a6a18d443 req-3f939e8e-53eb-4800-8296-c1044fe78248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e92b94-74d5-4161-ab5d-80b10c84bfb1", "name": "network-vif-deleted", "tag": "0950fa19-287f-4d83-950b-1cb1355203d6"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:07:07.749139 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-16ea1b18-ec28-4b01-bd2c-222a6a18d443 req-3f939e8e-53eb-4800-8296-c1044fe78248 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:07.756569 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-16ea1b18-ec28-4b01-bd2c-222a6a18d443 req-3f939e8e-53eb-4800-8296-c1044fe78248 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:07.762304 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-16ea1b18-ec28-4b01-bd2c-222a6a18d443 req-3f939e8e-53eb-4800-8296-c1044fe78248 service nova] Creating event network-vif-deleted:0950fa19-287f-4d83-950b-1cb1355203d6 for instance 67e92b94-74d5-4161-ab5d-80b10c84bfb1 on hv-cinder-85083 Aug 03 13:07:07.767556 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-16ea1b18-ec28-4b01-bd2c-222a6a18d443 req-3f939e8e-53eb-4800-8296-c1044fe78248 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032650 Aug 03 13:07:07.768817 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 412/822] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:07:07.852259 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-a109b66b-ee98-4d6d-8caa-3e150ea0eb3e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:07.853468 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-a109b66b-ee98-4d6d-8caa-3e150ea0eb3e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:07.861349 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a109b66b-ee98-4d6d-8caa-3e150ea0eb3e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:07.861971 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a109b66b-ee98-4d6d-8caa-3e150ea0eb3e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:07.862946 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a109b66b-ee98-4d6d-8caa-3e150ea0eb3e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:07.863540 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a109b66b-ee98-4d6d-8caa-3e150ea0eb3e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:07.969239 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-a109b66b-ee98-4d6d-8caa-3e150ea0eb3e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:07.980291 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-a109b66b-ee98-4d6d-8caa-3e150ea0eb3e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:07.982483 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-a109b66b-ee98-4d6d-8caa-3e150ea0eb3e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:07.984698 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-a109b66b-ee98-4d6d-8caa-3e150ea0eb3e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 200 len: 1656 microversion: 2.20 time: 0.136838 Aug 03 13:07:07.986136 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 411/823] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:07:07 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 1656 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:07:08.039971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-f709b580-4d44-4533-a593-e4637108a8e0 req-475e97d5-9934-4b62-bef3-f4e91bea697b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdddc591-873f-484c-ac08-022cdfd864c1", "tag": "7f9c7e63-c467-4d5b-b0fa-1fc75725b588"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:07:08.051580 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-f709b580-4d44-4533-a593-e4637108a8e0 req-475e97d5-9934-4b62-bef3-f4e91bea697b service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:08.051948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-f709b580-4d44-4533-a593-e4637108a8e0 req-475e97d5-9934-4b62-bef3-f4e91bea697b service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:08.064365 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-f709b580-4d44-4533-a593-e4637108a8e0 req-475e97d5-9934-4b62-bef3-f4e91bea697b service nova] Creating event network-changed:7f9c7e63-c467-4d5b-b0fa-1fc75725b588 for instance fdddc591-873f-484c-ac08-022cdfd864c1 on hv-cinder-85083 Aug 03 13:07:08.069958 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-f709b580-4d44-4533-a593-e4637108a8e0 req-475e97d5-9934-4b62-bef3-f4e91bea697b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034868 Aug 03 13:07:08.070918 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 413/824] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:07:09.011512 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d36b70ba-4854-4f5a-ab66-d9687095cb2e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:09.012104 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-d36b70ba-4854-4f5a-ab66-d9687095cb2e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:09.018543 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d36b70ba-4854-4f5a-ab66-d9687095cb2e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:09.019026 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d36b70ba-4854-4f5a-ab66-d9687095cb2e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:09.019784 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d36b70ba-4854-4f5a-ab66-d9687095cb2e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:09.020212 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d36b70ba-4854-4f5a-ab66-d9687095cb2e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:09.034070 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-d36b70ba-4854-4f5a-ab66-d9687095cb2e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] HTTP exception thrown: Instance 67e92b94-74d5-4161-ab5d-80b10c84bfb1 could not be found. Aug 03 13:07:09.035788 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d36b70ba-4854-4f5a-ab66-d9687095cb2e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Request method failure captured: Aug 03 13:07:09.035788 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 HTTP/1.1 Aug 03 13:07:09.035788 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 13:07:09.035788 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 13:07:09.035788 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 13:07:09.035788 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 0 Aug 03 13:07:09.035788 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 13:07:09.035788 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 13:07:09.035788 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 13:07:09.035788 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 13:07:09.035788 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nE71zelFFfGKJlRgXrGjLHThnj-8ig6uAcjJa1RghaqE1m9ZTUfUKiJ6hg9UPgcUYhQD3StQmEzsDREOR2sDhXhBK6adAd9GegMt7BWnzR-_iFaIhCl-0p46O7nDjI7-fUyDewdK7iYVDt2cQA8ka4JzKCKWEOPrGVkU9TokiY-SM8 Aug 03 13:07:09.035788 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 13:07:09.035788 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 13:07:09.035788 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 13:07:09.035788 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 13:07:09.035788 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 13:07:09.035788 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 13:07:09.035788 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 13:07:09.035788 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: 3a420d95334148b68d78a6497e0d95f5 Aug 03 13:07:09.035788 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-741141903 Aug 03 13:07:09.035788 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 13:07:09.035788 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 13:07:09.043015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3a420d95334148b68d78a6497e0d95f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a420d95334148b68d78a6497e0d95f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a420d95334148b68d78a6497e0d95f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3a420d95334148b68d78a6497e0d95f5", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:07:09.043015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-AttachVolumeShelveTestJSON-741141903 Aug 03 13:07:09.043015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: 3a420d95334148b68d78a6497e0d95f5 Aug 03 13:07:09.043015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-741141903 Aug 03 13:07:09.043015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-AttachVolumeShelveTestJSON-741141903-project Aug 03 13:07:09.043015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 13:07:09.043015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 13:07:09.043015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: 6ec4b53cb3a64c3aa9cb6a186a61c1fe Aug 03 13:07:09.043015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-AttachVolumeShelveTestJSON-741141903-project Aug 03 13:07:09.043015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: > Aug 03 13:07:09.043015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Instance 67e92b94-74d5-4161-ab5d-80b10c84bfb1 could not be found. Aug 03 13:07:09.043015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'id': '67e92b94-74d5-4161-ab5d-80b10c84bfb1'} Aug 03 13:07:09.043955 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:07:09.043955 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:07:09.043955 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:07:09.043955 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:07:09.043955 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:07:09.043955 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:07:09.043955 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:07:09.043955 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:07:09.043955 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:07:09.043955 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:07:09.043955 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67e92b94-74d5-4161-ab5d-80b10c84bfb1 could not be found. Aug 03 13:07:09.043955 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:07:09.043955 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:07:09.043955 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:07:09.043955 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:07:09.043955 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:07:09.043955 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:07:09.043955 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:07:09.043955 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:07:09.043955 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:07:09.045183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:07:09.045183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:07:09.045183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:07:09.045183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:07:09.045183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:07:09.045183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:07:09.045183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:07:09.045183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67e92b94-74d5-4161-ab5d-80b10c84bfb1 could not be found. Aug 03 13:07:09.045183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:07:09.045183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:07:09.045183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:07:09.045183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:07:09.045183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:07:09.045183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:07:09.045183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:07:09.045183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:07:09.045183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67e92b94-74d5-4161-ab5d-80b10c84bfb1 could not be found. Aug 03 13:07:09.045183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:07:09.046307 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d36b70ba-4854-4f5a-ab66-d9687095cb2e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Returning 404 to user: Instance 67e92b94-74d5-4161-ab5d-80b10c84bfb1 could not be found. {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:07:09.046307 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-d36b70ba-4854-4f5a-ab66-d9687095cb2e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 404 len: 111 microversion: 2.20 time: 0.030307 Aug 03 13:07:09.046307 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 412/825] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:07:09 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 13:07:09.047285 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-8330f430-2055-4683-90b5-b99b31ab8789 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '.version_select at 0x7fe6d80ff940>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:09.148411 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-8330f430-2055-4683-90b5-b99b31ab8789 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1389109726" status: 204 len: 0 microversion: 2.20 time: 0.105971 Aug 03 13:07:09.149002 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 414/826] 10.222.0.64 () {60 vars in 1262 bytes} [Wed Aug 3 13:07:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1389109726 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 13:07:09.907671 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-e81535ac-0f46-4d98-a679-e36f7888f037 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Action: 'create', calling method: .version_select at 0x7fe6d81b9820>, body: {"keypair": {"name": "tempest-keypair-234391505", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSiun3Vj7/Jzk/IlxJiVuRkvrCRP/XpHaIgcwuMKr+DyR6gfZ13HRzNGumZBVRZtaYARJGWcCPLqFCZw2wtba9U9XUz3wF0emZv9HhbuK7/7cAjuiR2Q+CcQKx/IAvCcg=="}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:07:09.923220 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-e81535ac-0f46-4d98-a679-e36f7888f037 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Getting quotas for project 3a420d95334148b68d78a6497e0d95f5. Resources: {'key_pairs'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 13:07:09.927130 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-e81535ac-0f46-4d98-a679-e36f7888f037 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Getting quotas for user 6ec4b53cb3a64c3aa9cb6a186a61c1fe and project 3a420d95334148b68d78a6497e0d95f5. Resources: {'key_pairs'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 13:07:10.006287 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-e81535ac-0f46-4d98-a679-e36f7888f037 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.102546 Aug 03 13:07:10.006913 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 413/827] 10.222.0.64 () {62 vars in 1200 bytes} [Wed Aug 3 13:07:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 104 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 03 13:07:12.095313 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-ada53ef4-1130-41b1-80f7-814af508a3ad tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1378529398", "imageRef": "c0aabcc0-d4af-4f0e-b8a5-d140344fce1f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "478554d7-f7a0-4b58-8d9d-6206d50b7fb1"}], "security_groups": [{"name": "tempest-securitygroup--1177281565"}], "key_name": "tempest-keypair-234391505", "user_data": "}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:07:12.201272 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.network.neutron [None req-ada53ef4-1130-41b1-80f7-814af508a3ad tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] validate_networks() for [('478554d7-f7a0-4b58-8d9d-6206d50b7fb1', None, None, None, None, None)] {{(pid=119410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 13:07:12.563436 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-ada53ef4-1130-41b1-80f7-814af508a3ad tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Flavor limits 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 13:07:12.563863 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-ada53ef4-1130-41b1-80f7-814af508a3ad tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Image limits 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 13:07:12.564546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-ada53ef4-1130-41b1-80f7-814af508a3ad tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Flavor pref 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 13:07:12.564982 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-ada53ef4-1130-41b1-80f7-814af508a3ad tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Image pref 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 13:07:12.565402 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-ada53ef4-1130-41b1-80f7-814af508a3ad tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 13:07:12.574281 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ada53ef4-1130-41b1-80f7-814af508a3ad tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:12.574751 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ada53ef4-1130-41b1-80f7-814af508a3ad tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:12.575575 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ada53ef4-1130-41b1-80f7-814af508a3ad tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:12.576041 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ada53ef4-1130-41b1-80f7-814af508a3ad tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:12.593456 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.quota [None req-ada53ef4-1130-41b1-80f7-814af508a3ad tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Getting quotas for project 3a420d95334148b68d78a6497e0d95f5. Resources: {'instances', 'ram', 'cores'} {{(pid=119410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 13:07:12.597388 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.quota [None req-ada53ef4-1130-41b1-80f7-814af508a3ad tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Getting quotas for user 6ec4b53cb3a64c3aa9cb6a186a61c1fe and project 3a420d95334148b68d78a6497e0d95f5. Resources: {'instances', 'ram', 'cores'} {{(pid=119410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 13:07:12.608719 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-ada53ef4-1130-41b1-80f7-814af508a3ad tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Going to run 1 instances... {{(pid=119410) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 13:07:12.611029 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-ada53ef4-1130-41b1-80f7-814af508a3ad tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0aabcc0-d4af-4f0e-b8a5-d140344fce1f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 13:07:12.754971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-ada53ef4-1130-41b1-80f7-814af508a3ad tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.664008 Aug 03 13:07:12.755632 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 415/828] 10.222.0.64 () {62 vars in 1188 bytes} [Wed Aug 3 13:07:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 13:07:12.766565 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-00bed6ec-4219-40b6-97f7-7cddab297676 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:12.767214 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-00bed6ec-4219-40b6-97f7-7cddab297676 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:12.824133 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-00bed6ec-4219-40b6-97f7-7cddab297676 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:12.832376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-00bed6ec-4219-40b6-97f7-7cddab297676 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:12.834779 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-00bed6ec-4219-40b6-97f7-7cddab297676 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:12.835750 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-00bed6ec-4219-40b6-97f7-7cddab297676 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1281 microversion: 2.20 time: 0.073171 Aug 03 13:07:12.836305 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 414/829] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:07:12 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:07:13.858644 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-c714b1bd-bb1c-43be-a67d-8c8a43e249a7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:13.859302 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-c714b1bd-bb1c-43be-a67d-8c8a43e249a7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:13.865563 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c714b1bd-bb1c-43be-a67d-8c8a43e249a7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:13.866014 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c714b1bd-bb1c-43be-a67d-8c8a43e249a7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:13.872765 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c714b1bd-bb1c-43be-a67d-8c8a43e249a7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:13.872765 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c714b1bd-bb1c-43be-a67d-8c8a43e249a7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:13.927179 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c714b1bd-bb1c-43be-a67d-8c8a43e249a7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:13.935647 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c714b1bd-bb1c-43be-a67d-8c8a43e249a7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:13.937151 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c714b1bd-bb1c-43be-a67d-8c8a43e249a7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:13.938280 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-c714b1bd-bb1c-43be-a67d-8c8a43e249a7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1285 microversion: 2.20 time: 0.084526 Aug 03 13:07:13.938853 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 416/830] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:07:13 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:07:14.963992 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-c2524fc8-ceb2-43ef-93c7-2e68c472fe27 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:14.963992 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-c2524fc8-ceb2-43ef-93c7-2e68c472fe27 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:14.968345 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c2524fc8-ceb2-43ef-93c7-2e68c472fe27 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:14.968804 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c2524fc8-ceb2-43ef-93c7-2e68c472fe27 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:14.969595 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c2524fc8-ceb2-43ef-93c7-2e68c472fe27 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:14.970041 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c2524fc8-ceb2-43ef-93c7-2e68c472fe27 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:15.039876 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-c2524fc8-ceb2-43ef-93c7-2e68c472fe27 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:15.048073 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-c2524fc8-ceb2-43ef-93c7-2e68c472fe27 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:15.049572 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-c2524fc8-ceb2-43ef-93c7-2e68c472fe27 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:15.051634 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-c2524fc8-ceb2-43ef-93c7-2e68c472fe27 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1341 microversion: 2.20 time: 0.094570 Aug 03 13:07:15.051634 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 415/831] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:07:14 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1341 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:07:16.074843 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-3391c66b-3716-4fae-bea8-8b3fffb34cf1 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:16.075457 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-3391c66b-3716-4fae-bea8-8b3fffb34cf1 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:16.082441 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3391c66b-3716-4fae-bea8-8b3fffb34cf1 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:16.082919 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3391c66b-3716-4fae-bea8-8b3fffb34cf1 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:16.083680 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3391c66b-3716-4fae-bea8-8b3fffb34cf1 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:16.084113 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3391c66b-3716-4fae-bea8-8b3fffb34cf1 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:16.223391 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-3391c66b-3716-4fae-bea8-8b3fffb34cf1 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:16.231917 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-3391c66b-3716-4fae-bea8-8b3fffb34cf1 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:16.233437 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-3391c66b-3716-4fae-bea8-8b3fffb34cf1 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:16.234573 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-3391c66b-3716-4fae-bea8-8b3fffb34cf1 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1407 microversion: 2.20 time: 0.164288 Aug 03 13:07:16.235196 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 417/832] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:07:16 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:07:16.359269 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-1a82b66a-09a1-491b-9dba-84dc92631615 req-ff19c14b-7f44-4562-b2a1-4874309fa173 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f0de60a-97c6-4897-a746-1c626065c1c7", "tag": "9a26950b-91c5-47f5-a903-f189d725973f"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:07:16.369735 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-1a82b66a-09a1-491b-9dba-84dc92631615 req-ff19c14b-7f44-4562-b2a1-4874309fa173 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:16.370617 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-1a82b66a-09a1-491b-9dba-84dc92631615 req-ff19c14b-7f44-4562-b2a1-4874309fa173 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:16.382221 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-1a82b66a-09a1-491b-9dba-84dc92631615 req-ff19c14b-7f44-4562-b2a1-4874309fa173 service nova] Creating event network-changed:9a26950b-91c5-47f5-a903-f189d725973f for instance 9f0de60a-97c6-4897-a746-1c626065c1c7 on hv-cinder-85083 Aug 03 13:07:16.388005 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-1a82b66a-09a1-491b-9dba-84dc92631615 req-ff19c14b-7f44-4562-b2a1-4874309fa173 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033109 Aug 03 13:07:16.388608 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 416/833] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:07:17.257621 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-af278490-1f2b-4922-b80e-1523456f3f78 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:17.258161 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-af278490-1f2b-4922-b80e-1523456f3f78 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:17.265297 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-af278490-1f2b-4922-b80e-1523456f3f78 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:17.265747 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-af278490-1f2b-4922-b80e-1523456f3f78 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:17.266541 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-af278490-1f2b-4922-b80e-1523456f3f78 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:17.267069 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-af278490-1f2b-4922-b80e-1523456f3f78 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:17.396697 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-af278490-1f2b-4922-b80e-1523456f3f78 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:17.405328 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-af278490-1f2b-4922-b80e-1523456f3f78 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:17.406778 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-af278490-1f2b-4922-b80e-1523456f3f78 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:17.407896 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-af278490-1f2b-4922-b80e-1523456f3f78 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1407 microversion: 2.20 time: 0.154289 Aug 03 13:07:17.408462 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 418/834] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:07:17 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:07:18.429907 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-36552824-bbb7-4140-a83a-ac8442cb7f9c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:18.430597 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-36552824-bbb7-4140-a83a-ac8442cb7f9c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:18.437202 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-36552824-bbb7-4140-a83a-ac8442cb7f9c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:18.437639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-36552824-bbb7-4140-a83a-ac8442cb7f9c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:18.438383 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-36552824-bbb7-4140-a83a-ac8442cb7f9c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:18.438834 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-36552824-bbb7-4140-a83a-ac8442cb7f9c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:18.572202 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-36552824-bbb7-4140-a83a-ac8442cb7f9c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:18.580577 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-36552824-bbb7-4140-a83a-ac8442cb7f9c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:18.582053 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-36552824-bbb7-4140-a83a-ac8442cb7f9c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:18.583153 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-36552824-bbb7-4140-a83a-ac8442cb7f9c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1407 microversion: 2.20 time: 0.157461 Aug 03 13:07:18.583721 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 417/835] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:07:18 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:07:19.605437 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d79ee496-6768-45cc-9fca-7dff3604c84d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:19.606039 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d79ee496-6768-45cc-9fca-7dff3604c84d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:19.612567 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d79ee496-6768-45cc-9fca-7dff3604c84d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:19.613019 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d79ee496-6768-45cc-9fca-7dff3604c84d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:19.613776 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d79ee496-6768-45cc-9fca-7dff3604c84d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:19.614211 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d79ee496-6768-45cc-9fca-7dff3604c84d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:19.742012 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d79ee496-6768-45cc-9fca-7dff3604c84d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:19.750682 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d79ee496-6768-45cc-9fca-7dff3604c84d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:19.752197 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d79ee496-6768-45cc-9fca-7dff3604c84d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:19.753296 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d79ee496-6768-45cc-9fca-7dff3604c84d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1407 microversion: 2.20 time: 0.151768 Aug 03 13:07:19.753863 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 419/836] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:07:19 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:07:20.775598 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-2f310ab1-761b-4c0b-aed5-d73fa2ed3cb6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:20.776209 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-2f310ab1-761b-4c0b-aed5-d73fa2ed3cb6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:20.782446 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2f310ab1-761b-4c0b-aed5-d73fa2ed3cb6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:20.783014 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2f310ab1-761b-4c0b-aed5-d73fa2ed3cb6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:20.784024 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2f310ab1-761b-4c0b-aed5-d73fa2ed3cb6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:20.784461 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2f310ab1-761b-4c0b-aed5-d73fa2ed3cb6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:20.911919 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-2f310ab1-761b-4c0b-aed5-d73fa2ed3cb6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:20.920634 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-2f310ab1-761b-4c0b-aed5-d73fa2ed3cb6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:20.924654 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-2f310ab1-761b-4c0b-aed5-d73fa2ed3cb6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:20.924654 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-2f310ab1-761b-4c0b-aed5-d73fa2ed3cb6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1407 microversion: 2.20 time: 0.151744 Aug 03 13:07:20.924654 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 418/837] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:07:20 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:07:21.945920 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-fc2efe6a-ba67-450e-b83c-1d78297bd13d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:21.946531 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-fc2efe6a-ba67-450e-b83c-1d78297bd13d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:21.953643 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fc2efe6a-ba67-450e-b83c-1d78297bd13d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:21.954100 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fc2efe6a-ba67-450e-b83c-1d78297bd13d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:21.954897 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fc2efe6a-ba67-450e-b83c-1d78297bd13d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:21.955363 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fc2efe6a-ba67-450e-b83c-1d78297bd13d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:22.084402 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-fc2efe6a-ba67-450e-b83c-1d78297bd13d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:22.092347 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-fc2efe6a-ba67-450e-b83c-1d78297bd13d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:22.095037 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-fc2efe6a-ba67-450e-b83c-1d78297bd13d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:22.096242 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-fc2efe6a-ba67-450e-b83c-1d78297bd13d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1407 microversion: 2.20 time: 0.154135 Aug 03 13:07:22.096779 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 420/838] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:07:21 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:07:22.589487 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-f6885451-efac-4517-a7ca-42d1cb414d2f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:22.590020 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-f6885451-efac-4517-a7ca-42d1cb414d2f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:22.596544 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f6885451-efac-4517-a7ca-42d1cb414d2f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:22.596994 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f6885451-efac-4517-a7ca-42d1cb414d2f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:22.597755 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f6885451-efac-4517-a7ca-42d1cb414d2f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:22.598183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f6885451-efac-4517-a7ca-42d1cb414d2f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:22.681399 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.objects.instance [None req-f6885451-efac-4517-a7ca-42d1cb414d2f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lazy-loading 'services' on Instance uuid 76bb2b00-bafa-4b66-98f4-882ae210fe14 {{(pid=119409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:07:22.828373 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell0:SELECT=6 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:07:22.879584 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:07:22.980701 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-f6885451-efac-4517-a7ca-42d1cb414d2f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "DELETE /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14/os-volume_attachments/797f90c8-0ac4-44d2-b116-4ac961ee4cf9" status: 202 len: 0 microversion: 2.1 time: 0.395467 Aug 03 13:07:22.981366 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 419/839] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Aug 3 13:07:22 2022] DELETE /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14/os-volume_attachments/797f90c8-0ac4-44d2-b116-4ac961ee4cf9 => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 13:07:22.989815 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-4a2952c5-c058-4469-b490-38128c66f708 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:22.992124 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-4a2952c5-c058-4469-b490-38128c66f708 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:22.994114 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=2 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:07:22.994805 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=6 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:07:23.000111 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4a2952c5-c058-4469-b490-38128c66f708 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:23.002151 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4a2952c5-c058-4469-b490-38128c66f708 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:23.002151 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4a2952c5-c058-4469-b490-38128c66f708 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:23.002151 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4a2952c5-c058-4469-b490-38128c66f708 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:23.032204 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-4a2952c5-c058-4469-b490-38128c66f708 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046394 Aug 03 13:07:23.032764 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 421/840] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 3 13:07:22 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:07:23.120164 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-5805fb6b-7cac-4aa8-8c9f-486f7eafc912 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:23.120948 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-5805fb6b-7cac-4aa8-8c9f-486f7eafc912 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:23.127210 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5805fb6b-7cac-4aa8-8c9f-486f7eafc912 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:23.127654 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5805fb6b-7cac-4aa8-8c9f-486f7eafc912 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:23.128401 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5805fb6b-7cac-4aa8-8c9f-486f7eafc912 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:23.128829 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5805fb6b-7cac-4aa8-8c9f-486f7eafc912 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:23.257121 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-5805fb6b-7cac-4aa8-8c9f-486f7eafc912 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:23.265498 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-5805fb6b-7cac-4aa8-8c9f-486f7eafc912 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:23.267019 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-5805fb6b-7cac-4aa8-8c9f-486f7eafc912 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:23.268090 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-5805fb6b-7cac-4aa8-8c9f-486f7eafc912 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1407 microversion: 2.20 time: 0.152751 Aug 03 13:07:23.268634 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 420/841] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:07:23 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:07:24.046060 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-caa6877f-96e0-45d9-89d4-36d9ba6af446 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:24.048269 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-caa6877f-96e0-45d9-89d4-36d9ba6af446 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:24.055481 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-caa6877f-96e0-45d9-89d4-36d9ba6af446 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:24.055945 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-caa6877f-96e0-45d9-89d4-36d9ba6af446 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:24.056710 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-caa6877f-96e0-45d9-89d4-36d9ba6af446 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:24.057180 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-caa6877f-96e0-45d9-89d4-36d9ba6af446 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:24.086683 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-caa6877f-96e0-45d9-89d4-36d9ba6af446 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045568 Aug 03 13:07:24.087276 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 422/842] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 3 13:07:24 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:07:24.290967 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-2f5dde83-093a-4bde-9f9e-57e6613d3abe tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:24.291649 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-2f5dde83-093a-4bde-9f9e-57e6613d3abe tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:24.299009 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2f5dde83-093a-4bde-9f9e-57e6613d3abe tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:24.302890 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2f5dde83-093a-4bde-9f9e-57e6613d3abe tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:24.302890 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2f5dde83-093a-4bde-9f9e-57e6613d3abe tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:24.302890 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2f5dde83-093a-4bde-9f9e-57e6613d3abe tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:24.447332 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-2f5dde83-093a-4bde-9f9e-57e6613d3abe tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:24.456346 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-2f5dde83-093a-4bde-9f9e-57e6613d3abe tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:24.457848 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-2f5dde83-093a-4bde-9f9e-57e6613d3abe tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:24.462922 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-2f5dde83-093a-4bde-9f9e-57e6613d3abe tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1407 microversion: 2.20 time: 0.172610 Aug 03 13:07:24.462922 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 421/843] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:07:24 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:07:24.464153 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-d3b779eb-9b14-4ad5-9524-88f359262fdb req-f6750127-0380-4cfd-b5bf-368f13be3e6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f0de60a-97c6-4897-a746-1c626065c1c7", "name": "network-vif-plugged", "status": "completed", "tag": "9a26950b-91c5-47f5-a903-f189d725973f"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:07:24.474243 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-d3b779eb-9b14-4ad5-9524-88f359262fdb req-f6750127-0380-4cfd-b5bf-368f13be3e6e service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:24.474694 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-d3b779eb-9b14-4ad5-9524-88f359262fdb req-f6750127-0380-4cfd-b5bf-368f13be3e6e service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:24.485699 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-d3b779eb-9b14-4ad5-9524-88f359262fdb req-f6750127-0380-4cfd-b5bf-368f13be3e6e service nova] Creating event network-vif-plugged:9a26950b-91c5-47f5-a903-f189d725973f for instance 9f0de60a-97c6-4897-a746-1c626065c1c7 on hv-cinder-85083 Aug 03 13:07:24.490823 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-d3b779eb-9b14-4ad5-9524-88f359262fdb req-f6750127-0380-4cfd-b5bf-368f13be3e6e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032197 Aug 03 13:07:24.491390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 423/844] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:07:25.099224 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-a82d4c43-0eaa-46d1-8cc1-ba7a2e95155d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:25.101364 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-a82d4c43-0eaa-46d1-8cc1-ba7a2e95155d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:25.107425 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a82d4c43-0eaa-46d1-8cc1-ba7a2e95155d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:25.107876 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a82d4c43-0eaa-46d1-8cc1-ba7a2e95155d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:25.108631 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a82d4c43-0eaa-46d1-8cc1-ba7a2e95155d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:25.109063 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a82d4c43-0eaa-46d1-8cc1-ba7a2e95155d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:25.137115 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-a82d4c43-0eaa-46d1-8cc1-ba7a2e95155d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041913 Aug 03 13:07:25.137654 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 422/845] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 3 13:07:25 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 13:07:25.222111 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-ffa498b7-f4ec-497b-b30f-56caa62174b2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:25.222696 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-ffa498b7-f4ec-497b-b30f-56caa62174b2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:25.228877 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ffa498b7-f4ec-497b-b30f-56caa62174b2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:25.229377 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ffa498b7-f4ec-497b-b30f-56caa62174b2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:25.230139 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ffa498b7-f4ec-497b-b30f-56caa62174b2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:25.230585 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ffa498b7-f4ec-497b-b30f-56caa62174b2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:25.254518 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-ffa498b7-f4ec-497b-b30f-56caa62174b2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Going to try to terminate instance {{(pid=119410) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 13:07:25.481893 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-103dc9bd-d465-4542-93fb-5e83aba4531a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:25.482497 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-103dc9bd-d465-4542-93fb-5e83aba4531a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:25.489132 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-103dc9bd-d465-4542-93fb-5e83aba4531a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:25.489596 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-103dc9bd-d465-4542-93fb-5e83aba4531a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:25.490417 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-103dc9bd-d465-4542-93fb-5e83aba4531a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:25.490881 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-103dc9bd-d465-4542-93fb-5e83aba4531a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:25.550202 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-ffa498b7-f4ec-497b-b30f-56caa62174b2 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "DELETE /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 204 len: 0 microversion: 2.1 time: 0.331987 Aug 03 13:07:25.550475 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 424/846] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 3 13:07:25 2022] DELETE /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 13:07:25.559381 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-dfa8f391-19a4-414c-a3b4-1c9365f222e3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:25.560066 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-dfa8f391-19a4-414c-a3b4-1c9365f222e3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:25.566153 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-dfa8f391-19a4-414c-a3b4-1c9365f222e3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:25.566598 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-dfa8f391-19a4-414c-a3b4-1c9365f222e3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:25.567385 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-dfa8f391-19a4-414c-a3b4-1c9365f222e3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:25.567816 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-dfa8f391-19a4-414c-a3b4-1c9365f222e3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:25.646703 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-103dc9bd-d465-4542-93fb-5e83aba4531a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:25.657777 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-103dc9bd-d465-4542-93fb-5e83aba4531a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:25.660918 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-103dc9bd-d465-4542-93fb-5e83aba4531a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:25.662969 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-103dc9bd-d465-4542-93fb-5e83aba4531a tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1407 microversion: 2.20 time: 0.184643 Aug 03 13:07:25.663990 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 423/847] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:07:25 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:07:25.721841 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-dfa8f391-19a4-414c-a3b4-1c9365f222e3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:25.729757 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-dfa8f391-19a4-414c-a3b4-1c9365f222e3 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1688 microversion: 2.1 time: 0.174678 Aug 03 13:07:25.730311 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 425/848] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:07:25 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:07:26.688169 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-34e1d235-b4ae-442a-a3d7-a09210eea7c3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:26.688761 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-34e1d235-b4ae-442a-a3d7-a09210eea7c3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:26.695220 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-34e1d235-b4ae-442a-a3d7-a09210eea7c3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:26.695670 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-34e1d235-b4ae-442a-a3d7-a09210eea7c3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:26.696459 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-34e1d235-b4ae-442a-a3d7-a09210eea7c3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:26.696920 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-34e1d235-b4ae-442a-a3d7-a09210eea7c3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:26.750671 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-31a82812-2b3d-44d5-972d-47ce028040aa tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:26.751303 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-31a82812-2b3d-44d5-972d-47ce028040aa tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:26.757742 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-31a82812-2b3d-44d5-972d-47ce028040aa tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:26.758182 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-31a82812-2b3d-44d5-972d-47ce028040aa tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:26.758991 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-31a82812-2b3d-44d5-972d-47ce028040aa tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:26.759422 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-31a82812-2b3d-44d5-972d-47ce028040aa tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:26.865476 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-34e1d235-b4ae-442a-a3d7-a09210eea7c3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:26.872514 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-34e1d235-b4ae-442a-a3d7-a09210eea7c3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:26.874205 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-34e1d235-b4ae-442a-a3d7-a09210eea7c3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:26.875338 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-34e1d235-b4ae-442a-a3d7-a09210eea7c3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1407 microversion: 2.20 time: 0.191084 Aug 03 13:07:26.875905 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 424/849] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:07:26 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:07:26.908036 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-31a82812-2b3d-44d5-972d-47ce028040aa tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:26.915854 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-31a82812-2b3d-44d5-972d-47ce028040aa tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1688 microversion: 2.1 time: 0.168987 Aug 03 13:07:26.916432 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 426/850] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:07:26 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:07:27.898840 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ac049f72-b3fb-4185-905f-1253cec57c2f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:27.899444 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-ac049f72-b3fb-4185-905f-1253cec57c2f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:27.906049 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ac049f72-b3fb-4185-905f-1253cec57c2f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:27.906426 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ac049f72-b3fb-4185-905f-1253cec57c2f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:27.907213 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ac049f72-b3fb-4185-905f-1253cec57c2f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:27.907642 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ac049f72-b3fb-4185-905f-1253cec57c2f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:27.938001 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-45eaaecb-88d5-415c-83f4-d40e8d0ce4fd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:27.938616 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-45eaaecb-88d5-415c-83f4-d40e8d0ce4fd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:27.944705 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-45eaaecb-88d5-415c-83f4-d40e8d0ce4fd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:27.945161 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-45eaaecb-88d5-415c-83f4-d40e8d0ce4fd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:27.945924 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-45eaaecb-88d5-415c-83f4-d40e8d0ce4fd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:27.946369 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-45eaaecb-88d5-415c-83f4-d40e8d0ce4fd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:28.088949 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ac049f72-b3fb-4185-905f-1253cec57c2f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:28.096689 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ac049f72-b3fb-4185-905f-1253cec57c2f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:28.098193 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ac049f72-b3fb-4185-905f-1253cec57c2f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:28.099311 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-ac049f72-b3fb-4185-905f-1253cec57c2f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1407 microversion: 2.20 time: 0.204419 Aug 03 13:07:28.099899 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 425/851] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:07:27 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:07:28.114629 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-45eaaecb-88d5-415c-83f4-d40e8d0ce4fd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:28.118215 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:07:28.123137 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-45eaaecb-88d5-415c-83f4-d40e8d0ce4fd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1688 microversion: 2.1 time: 0.189049 Aug 03 13:07:28.123708 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 427/852] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:07:27 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1688 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:07:29.121610 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-f4d6db70-4bb5-4b16-bb2d-20911226876d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:29.122130 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-f4d6db70-4bb5-4b16-bb2d-20911226876d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:29.128706 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f4d6db70-4bb5-4b16-bb2d-20911226876d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:29.129154 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f4d6db70-4bb5-4b16-bb2d-20911226876d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:29.129907 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f4d6db70-4bb5-4b16-bb2d-20911226876d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:29.130343 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f4d6db70-4bb5-4b16-bb2d-20911226876d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:29.151330 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-8f851f40-bbc7-427f-b068-50b245d639e1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:29.151957 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-8f851f40-bbc7-427f-b068-50b245d639e1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:29.159403 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8f851f40-bbc7-427f-b068-50b245d639e1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:29.159860 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8f851f40-bbc7-427f-b068-50b245d639e1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:29.160657 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8f851f40-bbc7-427f-b068-50b245d639e1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:29.161099 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8f851f40-bbc7-427f-b068-50b245d639e1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:29.563135 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-f4d6db70-4bb5-4b16-bb2d-20911226876d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:29.563277 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-8f851f40-bbc7-427f-b068-50b245d639e1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:29.563603 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-f4d6db70-4bb5-4b16-bb2d-20911226876d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:29.563836 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-f4d6db70-4bb5-4b16-bb2d-20911226876d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:29.564919 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-f4d6db70-4bb5-4b16-bb2d-20911226876d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1407 microversion: 2.20 time: 0.447805 Aug 03 13:07:29.565470 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 426/853] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:07:29 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1407 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:07:29.565700 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-8f851f40-bbc7-427f-b068-50b245d639e1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1688 microversion: 2.1 time: 0.420564 Aug 03 13:07:29.566252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 428/854] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:07:29 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1688 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:07:30.587140 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-f2679b93-4715-4c0f-97f4-2404b7df6727 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:30.587967 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-f2679b93-4715-4c0f-97f4-2404b7df6727 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:30.589081 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-6506f85d-8a69-4d63-9a27-c963149cc8df tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:30.589697 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-6506f85d-8a69-4d63-9a27-c963149cc8df tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:30.595596 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f2679b93-4715-4c0f-97f4-2404b7df6727 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:30.596127 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f2679b93-4715-4c0f-97f4-2404b7df6727 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:30.596308 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6506f85d-8a69-4d63-9a27-c963149cc8df tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:30.596730 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6506f85d-8a69-4d63-9a27-c963149cc8df tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:30.597099 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f2679b93-4715-4c0f-97f4-2404b7df6727 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:30.597488 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6506f85d-8a69-4d63-9a27-c963149cc8df tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:30.597593 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f2679b93-4715-4c0f-97f4-2404b7df6727 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:30.598053 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6506f85d-8a69-4d63-9a27-c963149cc8df tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:30.791939 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-6506f85d-8a69-4d63-9a27-c963149cc8df tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:30.799649 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-f2679b93-4715-4c0f-97f4-2404b7df6727 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:30.800842 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-6506f85d-8a69-4d63-9a27-c963149cc8df tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:30.802389 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-6506f85d-8a69-4d63-9a27-c963149cc8df tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:30.803618 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-6506f85d-8a69-4d63-9a27-c963149cc8df tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1600 microversion: 2.20 time: 0.219601 Aug 03 13:07:30.804176 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 429/855] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:07:30 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1600 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:07:30.815021 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-f2679b93-4715-4c0f-97f4-2404b7df6727 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1688 microversion: 2.1 time: 0.225315 Aug 03 13:07:30.815021 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 427/856] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:07:30 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1688 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:07:30.827554 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-01d2117e-d00a-436e-bc8f-6f58b7b96d18 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:30.828042 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-01d2117e-d00a-436e-bc8f-6f58b7b96d18 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:30.834246 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-01d2117e-d00a-436e-bc8f-6f58b7b96d18 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:30.834687 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-01d2117e-d00a-436e-bc8f-6f58b7b96d18 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:30.835425 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-01d2117e-d00a-436e-bc8f-6f58b7b96d18 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:30.835856 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-01d2117e-d00a-436e-bc8f-6f58b7b96d18 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:30.919653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-01d2117e-d00a-436e-bc8f-6f58b7b96d18 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.095935 Aug 03 13:07:30.922771 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 428/857] 10.222.0.64 () {60 vars in 1316 bytes} [Wed Aug 3 13:07:30 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 13:07:31.723367 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-e33a175d-3c41-40ad-acd3-d832b49c7dff req-e40b8dc0-45e7-493f-b463-c73efb275508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76bb2b00-bafa-4b66-98f4-882ae210fe14", "name": "network-vif-deleted", "tag": "9b3298cc-4607-4438-a82a-2051f630b8a0"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:07:31.735291 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-e33a175d-3c41-40ad-acd3-d832b49c7dff req-e40b8dc0-45e7-493f-b463-c73efb275508 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:31.736248 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-e33a175d-3c41-40ad-acd3-d832b49c7dff req-e40b8dc0-45e7-493f-b463-c73efb275508 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:31.749435 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-e33a175d-3c41-40ad-acd3-d832b49c7dff req-e40b8dc0-45e7-493f-b463-c73efb275508 service nova] Creating event network-vif-deleted:9b3298cc-4607-4438-a82a-2051f630b8a0 for instance 76bb2b00-bafa-4b66-98f4-882ae210fe14 on hv-cinder-85083 Aug 03 13:07:31.755282 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-e33a175d-3c41-40ad-acd3-d832b49c7dff req-e40b8dc0-45e7-493f-b463-c73efb275508 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036524 Aug 03 13:07:31.756607 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 430/858] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:07:31.830834 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-b4fb7ee2-884e-4059-ac88-11a0d9c06af9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:31.831870 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-b4fb7ee2-884e-4059-ac88-11a0d9c06af9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:31.839564 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b4fb7ee2-884e-4059-ac88-11a0d9c06af9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:31.841730 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b4fb7ee2-884e-4059-ac88-11a0d9c06af9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:31.841730 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b4fb7ee2-884e-4059-ac88-11a0d9c06af9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:31.841730 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b4fb7ee2-884e-4059-ac88-11a0d9c06af9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:31.914532 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b4fb7ee2-884e-4059-ac88-11a0d9c06af9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:31.919219 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-b4fb7ee2-884e-4059-ac88-11a0d9c06af9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1621 microversion: 2.1 time: 0.093073 Aug 03 13:07:31.920116 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 429/859] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:07:31 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1621 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:07:32.943709 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-cc7136fb-5657-40b4-957f-69481fdca9de tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:32.944412 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-cc7136fb-5657-40b4-957f-69481fdca9de tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:32.951449 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cc7136fb-5657-40b4-957f-69481fdca9de tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:32.951897 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cc7136fb-5657-40b4-957f-69481fdca9de tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:32.952679 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cc7136fb-5657-40b4-957f-69481fdca9de tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:32.953109 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cc7136fb-5657-40b4-957f-69481fdca9de tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:32.985859 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:07:32.989781 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cc7136fb-5657-40b4-957f-69481fdca9de tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:32.990242 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cc7136fb-5657-40b4-957f-69481fdca9de tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:32.990696 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-cc7136fb-5657-40b4-957f-69481fdca9de tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lazy-loading 'fault' on Instance uuid 76bb2b00-bafa-4b66-98f4-882ae210fe14 {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:07:33.050141 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-cc7136fb-5657-40b4-957f-69481fdca9de tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:33.058592 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-cc7136fb-5657-40b4-957f-69481fdca9de tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 200 len: 1336 microversion: 2.1 time: 0.119159 Aug 03 13:07:33.066873 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 431/860] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:07:32 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 1336 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:07:33.771039 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-fe25f20a-17d5-4b0c-9e21-803dc6db4d78 req-bce1c3c7-a19d-4988-afb0-37c1ee0431f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f0de60a-97c6-4897-a746-1c626065c1c7", "tag": "9a26950b-91c5-47f5-a903-f189d725973f"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:07:33.781317 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-fe25f20a-17d5-4b0c-9e21-803dc6db4d78 req-bce1c3c7-a19d-4988-afb0-37c1ee0431f8 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:33.781606 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-fe25f20a-17d5-4b0c-9e21-803dc6db4d78 req-bce1c3c7-a19d-4988-afb0-37c1ee0431f8 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:33.792975 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-fe25f20a-17d5-4b0c-9e21-803dc6db4d78 req-bce1c3c7-a19d-4988-afb0-37c1ee0431f8 service nova] Creating event network-changed:9a26950b-91c5-47f5-a903-f189d725973f for instance 9f0de60a-97c6-4897-a746-1c626065c1c7 on hv-cinder-85083 Aug 03 13:07:33.798022 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-fe25f20a-17d5-4b0c-9e21-803dc6db4d78 req-bce1c3c7-a19d-4988-afb0-37c1ee0431f8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030760 Aug 03 13:07:33.798846 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 430/861] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:07:34.079901 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-3d43131c-f64f-4d76-b212-c2fc078c9aca tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:34.080538 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-3d43131c-f64f-4d76-b212-c2fc078c9aca tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: 76bb2b00-bafa-4b66-98f4-882ae210fe14] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:34.087614 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3d43131c-f64f-4d76-b212-c2fc078c9aca tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:34.088058 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3d43131c-f64f-4d76-b212-c2fc078c9aca tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:34.088814 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3d43131c-f64f-4d76-b212-c2fc078c9aca tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:34.089249 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3d43131c-f64f-4d76-b212-c2fc078c9aca tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:34.105595 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.wsgi [None req-3d43131c-f64f-4d76-b212-c2fc078c9aca tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] HTTP exception thrown: Instance 76bb2b00-bafa-4b66-98f4-882ae210fe14 could not be found. Aug 03 13:07:34.107335 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-3d43131c-f64f-4d76-b212-c2fc078c9aca tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Request method failure captured: Aug 03 13:07:34.107335 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: request: GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 HTTP/1.1 Aug 03 13:07:34.107335 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept: application/json Aug 03 13:07:34.107335 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept-Encoding: identity Aug 03 13:07:34.107335 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Connection: close Aug 03 13:07:34.107335 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Length: 0 Aug 03 13:07:34.107335 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Type: application/json Aug 03 13:07:34.107335 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Host: 10.222.0.64 Aug 03 13:07:34.107335 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Openstack-System-Scope: None Aug 03 13:07:34.107335 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: User-Agent: python-urllib3/1.26.10 Aug 03 13:07:34.107335 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Auth-Token: gAAAAABi6nEyeq1aA1DnWg7YkrE7D7bgGX9PT3-iXVy9M8Ibjz8s_-Ya_DEsxR7W_QOmRw1tPup_D6mHy2sBVRW5GVp8rEJSTe-zvtUT4dMGtJrZFsYShgkC-wDTETwNYIQHR5pBl-lDcgJcvGJPrB8PSIjI-ebaXTKQTexfbZ3prTy1VXvIMP0 Aug 03 13:07:34.107335 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Id: None Aug 03 13:07:34.107335 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Name: None Aug 03 13:07:34.107335 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Identity-Status: Confirmed Aug 03 13:07:34.107335 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Is-Admin-Project: True Aug 03 13:07:34.107335 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Id: default Aug 03 13:07:34.107335 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Name: Default Aug 03 13:07:34.107335 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Id: 6be1056fe005471f83a0633c99c0b349 Aug 03 13:07:34.107335 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1367109722 Aug 03 13:07:34.107335 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Role: member,reader Aug 03 13:07:34.107335 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Roles: member,reader Aug 03 13:07:34.108948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6be1056fe005471f83a0633c99c0b349"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6be1056fe005471f83a0633c99c0b349"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6be1056fe005471f83a0633c99c0b349"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6be1056fe005471f83a0633c99c0b349", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:07:34.108948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1367109722 Aug 03 13:07:34.108948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Id: 6be1056fe005471f83a0633c99c0b349 Aug 03 13:07:34.108948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1367109722 Aug 03 13:07:34.108948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User: tempest-ServerRescueNegativeTestJSON-1367109722-project Aug 03 13:07:34.108948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Id: default Aug 03 13:07:34.108948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Name: Default Aug 03 13:07:34.108948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Id: bb5f78a0ee0642c7bbde2ecf34e090d0 Aug 03 13:07:34.108948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1367109722-project Aug 03 13:07:34.108948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: method: > Aug 03 13:07:34.108948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: exception: Instance 76bb2b00-bafa-4b66-98f4-882ae210fe14 could not be found. Aug 03 13:07:34.108948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: action_args: {'id': '76bb2b00-bafa-4b66-98f4-882ae210fe14'} Aug 03 13:07:34.109867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:07:34.109867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:07:34.109867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:07:34.109867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:07:34.109867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:07:34.109867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:07:34.109867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:07:34.109867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:07:34.109867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:07:34.109867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:07:34.109867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76bb2b00-bafa-4b66-98f4-882ae210fe14 could not be found. Aug 03 13:07:34.109867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:07:34.109867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:07:34.109867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:07:34.109867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:07:34.109867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:07:34.109867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:07:34.109867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:07:34.109867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:07:34.109867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:07:34.111506 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:07:34.111506 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:07:34.111506 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:07:34.111506 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:07:34.111506 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:07:34.111506 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:07:34.111506 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:07:34.111506 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76bb2b00-bafa-4b66-98f4-882ae210fe14 could not be found. Aug 03 13:07:34.111506 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:07:34.111506 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:07:34.111506 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:07:34.111506 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:07:34.111506 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:07:34.111506 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:07:34.111506 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:07:34.111506 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:07:34.111506 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76bb2b00-bafa-4b66-98f4-882ae210fe14 could not be found. Aug 03 13:07:34.111506 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:07:34.113770 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-3d43131c-f64f-4d76-b212-c2fc078c9aca tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Returning 404 to user: Instance 76bb2b00-bafa-4b66-98f4-882ae210fe14 could not be found. {{(pid=119410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:07:34.113770 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-3d43131c-f64f-4d76-b212-c2fc078c9aca tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14" status: 404 len: 111 microversion: 2.1 time: 0.033070 Aug 03 13:07:34.113770 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 432/862] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:07:34 2022] GET /compute/v2.1/servers/76bb2b00-bafa-4b66-98f4-882ae210fe14 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:07:34.120074 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-cf94fde4-b3ab-4bed-8409-b47ee422274d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '.version_select at 0x7fe6d814b550>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:34.194429 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-cf94fde4-b3ab-4bed-8409-b47ee422274d tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1041308654" status: 202 len: 0 microversion: 2.1 time: 0.079986 Aug 03 13:07:34.198262 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 431/863] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Aug 3 13:07:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1041308654 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 13:07:37.559373 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-35d66c59-5bbe-440f-af8c-e838af9c07e9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:37.559867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-35d66c59-5bbe-440f-af8c-e838af9c07e9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:37.566852 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-35d66c59-5bbe-440f-af8c-e838af9c07e9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:37.567319 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-35d66c59-5bbe-440f-af8c-e838af9c07e9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:37.568068 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-35d66c59-5bbe-440f-af8c-e838af9c07e9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:37.568497 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-35d66c59-5bbe-440f-af8c-e838af9c07e9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:37.593578 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-35d66c59-5bbe-440f-af8c-e838af9c07e9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Going to try to terminate instance {{(pid=119410) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 13:07:37.788509 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-35d66c59-5bbe-440f-af8c-e838af9c07e9 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "DELETE /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 204 len: 0 microversion: 2.1 time: 0.232649 Aug 03 13:07:37.789051 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 433/864] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 3 13:07:37 2022] DELETE /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 13:07:37.798142 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-a447a3a9-825a-4fc2-bbbe-d2c22cb3783f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:37.798934 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-a447a3a9-825a-4fc2-bbbe-d2c22cb3783f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:37.800838 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:07:37.805760 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a447a3a9-825a-4fc2-bbbe-d2c22cb3783f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:37.806209 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a447a3a9-825a-4fc2-bbbe-d2c22cb3783f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:37.807068 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a447a3a9-825a-4fc2-bbbe-d2c22cb3783f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:37.807509 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a447a3a9-825a-4fc2-bbbe-d2c22cb3783f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:37.940662 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-a447a3a9-825a-4fc2-bbbe-d2c22cb3783f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:37.948104 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-a447a3a9-825a-4fc2-bbbe-d2c22cb3783f tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1507 microversion: 2.1 time: 0.154765 Aug 03 13:07:37.949166 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 432/865] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:07:37 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:07:38.970159 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-f2063eee-2053-48f0-a914-c407a474e65c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:38.970915 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-f2063eee-2053-48f0-a914-c407a474e65c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:38.977443 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f2063eee-2053-48f0-a914-c407a474e65c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:38.977900 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f2063eee-2053-48f0-a914-c407a474e65c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:38.978767 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f2063eee-2053-48f0-a914-c407a474e65c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:38.979214 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f2063eee-2053-48f0-a914-c407a474e65c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:39.111508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-f2063eee-2053-48f0-a914-c407a474e65c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:39.117275 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-f2063eee-2053-48f0-a914-c407a474e65c tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1507 microversion: 2.1 time: 0.151584 Aug 03 13:07:39.117846 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 434/866] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:07:38 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:07:39.382063 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-c2dde099-20f5-4a00-b932-3ffe43af220f req-bea03f09-2b5d-4bea-9c38-cdac80350304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db6cbbae-a113-4148-901c-8509aa6c1ef9", "name": "network-vif-deleted", "tag": "2f56c840-bc27-4124-a3da-31ed38743b82"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:07:39.393067 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-c2dde099-20f5-4a00-b932-3ffe43af220f req-bea03f09-2b5d-4bea-9c38-cdac80350304 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:39.393502 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-c2dde099-20f5-4a00-b932-3ffe43af220f req-bea03f09-2b5d-4bea-9c38-cdac80350304 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:39.405795 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-c2dde099-20f5-4a00-b932-3ffe43af220f req-bea03f09-2b5d-4bea-9c38-cdac80350304 service nova] Creating event network-vif-deleted:2f56c840-bc27-4124-a3da-31ed38743b82 for instance db6cbbae-a113-4148-901c-8509aa6c1ef9 on hv-cinder-85083 Aug 03 13:07:39.411467 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-c2dde099-20f5-4a00-b932-3ffe43af220f req-bea03f09-2b5d-4bea-9c38-cdac80350304 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032833 Aug 03 13:07:39.412043 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 433/867] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:07:40.139223 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-c7214d0f-1600-47fe-a7ac-7cd09cb01fbf tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:40.139829 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-c7214d0f-1600-47fe-a7ac-7cd09cb01fbf tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:40.146440 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c7214d0f-1600-47fe-a7ac-7cd09cb01fbf tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:40.146922 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c7214d0f-1600-47fe-a7ac-7cd09cb01fbf tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:40.147678 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c7214d0f-1600-47fe-a7ac-7cd09cb01fbf tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:40.148106 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c7214d0f-1600-47fe-a7ac-7cd09cb01fbf tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:40.179134 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c7214d0f-1600-47fe-a7ac-7cd09cb01fbf tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:40.179513 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c7214d0f-1600-47fe-a7ac-7cd09cb01fbf tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:40.179956 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-c7214d0f-1600-47fe-a7ac-7cd09cb01fbf tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lazy-loading 'fault' on Instance uuid db6cbbae-a113-4148-901c-8509aa6c1ef9 {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:07:40.221301 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c7214d0f-1600-47fe-a7ac-7cd09cb01fbf tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:40.228629 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-c7214d0f-1600-47fe-a7ac-7cd09cb01fbf tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 200 len: 1312 microversion: 2.1 time: 0.093737 Aug 03 13:07:40.229191 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 435/868] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:07:40 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 1312 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:07:41.250227 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-80ae6b78-3c81-4c16-941e-04f13fe406b1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:41.250948 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-80ae6b78-3c81-4c16-941e-04f13fe406b1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: db6cbbae-a113-4148-901c-8509aa6c1ef9] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:41.257982 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-80ae6b78-3c81-4c16-941e-04f13fe406b1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:41.258423 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-80ae6b78-3c81-4c16-941e-04f13fe406b1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:41.259196 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-80ae6b78-3c81-4c16-941e-04f13fe406b1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:41.259622 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-80ae6b78-3c81-4c16-941e-04f13fe406b1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:41.273076 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-80ae6b78-3c81-4c16-941e-04f13fe406b1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] HTTP exception thrown: Instance db6cbbae-a113-4148-901c-8509aa6c1ef9 could not be found. Aug 03 13:07:41.274653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-80ae6b78-3c81-4c16-941e-04f13fe406b1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Request method failure captured: Aug 03 13:07:41.274653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 HTTP/1.1 Aug 03 13:07:41.274653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 13:07:41.274653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 13:07:41.274653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 13:07:41.274653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 0 Aug 03 13:07:41.274653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 13:07:41.274653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 13:07:41.274653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 13:07:41.274653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 13:07:41.274653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nEyeq1aA1DnWg7YkrE7D7bgGX9PT3-iXVy9M8Ibjz8s_-Ya_DEsxR7W_QOmRw1tPup_D6mHy2sBVRW5GVp8rEJSTe-zvtUT4dMGtJrZFsYShgkC-wDTETwNYIQHR5pBl-lDcgJcvGJPrB8PSIjI-ebaXTKQTexfbZ3prTy1VXvIMP0 Aug 03 13:07:41.274653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 13:07:41.274653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 13:07:41.274653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 13:07:41.274653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 13:07:41.274653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 13:07:41.274653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 13:07:41.274653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: 6be1056fe005471f83a0633c99c0b349 Aug 03 13:07:41.274653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1367109722 Aug 03 13:07:41.274653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 13:07:41.274653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 13:07:41.276226 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6be1056fe005471f83a0633c99c0b349"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6be1056fe005471f83a0633c99c0b349"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6be1056fe005471f83a0633c99c0b349"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6be1056fe005471f83a0633c99c0b349", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:07:41.276226 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1367109722 Aug 03 13:07:41.276226 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: 6be1056fe005471f83a0633c99c0b349 Aug 03 13:07:41.276226 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1367109722 Aug 03 13:07:41.276226 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-ServerRescueNegativeTestJSON-1367109722-project Aug 03 13:07:41.276226 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 13:07:41.276226 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 13:07:41.276226 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: bb5f78a0ee0642c7bbde2ecf34e090d0 Aug 03 13:07:41.276226 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1367109722-project Aug 03 13:07:41.276226 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: > Aug 03 13:07:41.276226 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Instance db6cbbae-a113-4148-901c-8509aa6c1ef9 could not be found. Aug 03 13:07:41.276226 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'id': 'db6cbbae-a113-4148-901c-8509aa6c1ef9'} Aug 03 13:07:41.277034 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:07:41.277034 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:07:41.277034 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:07:41.277034 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:07:41.277034 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:07:41.277034 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:07:41.277034 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:07:41.277034 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:07:41.277034 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:07:41.277034 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:07:41.277034 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db6cbbae-a113-4148-901c-8509aa6c1ef9 could not be found. Aug 03 13:07:41.277034 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:07:41.277034 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:07:41.277034 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:07:41.277034 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:07:41.277034 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:07:41.277034 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:07:41.277034 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:07:41.277034 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:07:41.277034 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:07:41.278507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:07:41.278507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:07:41.278507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:07:41.278507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:07:41.278507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:07:41.278507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:07:41.278507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:07:41.278507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db6cbbae-a113-4148-901c-8509aa6c1ef9 could not be found. Aug 03 13:07:41.278507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:07:41.278507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:07:41.278507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:07:41.278507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:07:41.278507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:07:41.278507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:07:41.278507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:07:41.278507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:07:41.278507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db6cbbae-a113-4148-901c-8509aa6c1ef9 could not be found. Aug 03 13:07:41.278507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:07:41.279801 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-80ae6b78-3c81-4c16-941e-04f13fe406b1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Returning 404 to user: Instance db6cbbae-a113-4148-901c-8509aa6c1ef9 could not be found. {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:07:41.279801 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-80ae6b78-3c81-4c16-941e-04f13fe406b1 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9" status: 404 len: 111 microversion: 2.1 time: 0.030457 Aug 03 13:07:41.279801 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 434/869] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:07:41 2022] GET /compute/v2.1/servers/db6cbbae-a113-4148-901c-8509aa6c1ef9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:07:41.284651 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-38755a17-fa53-4baa-a8b2-aa2993f20991 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:41.285203 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-38755a17-fa53-4baa-a8b2-aa2993f20991 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:41.291743 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-38755a17-fa53-4baa-a8b2-aa2993f20991 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:41.292198 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-38755a17-fa53-4baa-a8b2-aa2993f20991 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:41.292961 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-38755a17-fa53-4baa-a8b2-aa2993f20991 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:41.293404 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-38755a17-fa53-4baa-a8b2-aa2993f20991 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:41.318093 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-38755a17-fa53-4baa-a8b2-aa2993f20991 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Going to try to terminate instance {{(pid=119410) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 13:07:41.577564 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-38755a17-fa53-4baa-a8b2-aa2993f20991 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "DELETE /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 204 len: 0 microversion: 2.1 time: 0.296614 Aug 03 13:07:41.578179 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 436/870] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 3 13:07:41 2022] DELETE /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 13:07:41.586190 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-b96949d9-88e2-4697-9312-462370c4d7dd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:41.586890 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-b96949d9-88e2-4697-9312-462370c4d7dd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:41.592926 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b96949d9-88e2-4697-9312-462370c4d7dd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:41.593368 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b96949d9-88e2-4697-9312-462370c4d7dd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:41.594117 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b96949d9-88e2-4697-9312-462370c4d7dd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:41.594546 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b96949d9-88e2-4697-9312-462370c4d7dd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:41.726727 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b96949d9-88e2-4697-9312-462370c4d7dd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:41.734705 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-b96949d9-88e2-4697-9312-462370c4d7dd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.152358 Aug 03 13:07:41.735300 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 435/871] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:07:41 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:07:42.756572 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-7383120a-3922-4ebf-a301-20e71776adf0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:42.757200 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-7383120a-3922-4ebf-a301-20e71776adf0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:42.764412 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7383120a-3922-4ebf-a301-20e71776adf0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:42.764875 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7383120a-3922-4ebf-a301-20e71776adf0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:42.765648 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7383120a-3922-4ebf-a301-20e71776adf0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:42.766091 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7383120a-3922-4ebf-a301-20e71776adf0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:42.895407 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-7383120a-3922-4ebf-a301-20e71776adf0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:42.903062 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-7383120a-3922-4ebf-a301-20e71776adf0 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1521 microversion: 2.1 time: 0.150788 Aug 03 13:07:42.903833 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 437/872] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:07:42 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:07:42.987297 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-3c6aa02d-c49a-4fe4-ae76-34faaf7550b1 req-d2a3b5de-28b5-45e7-b6d8-88030e9cad3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39c466e-0f7f-48d9-accb-da8ecd932142", "name": "network-vif-deleted", "tag": "bb8defef-013e-4d49-8621-5b924722dedc"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:07:42.997884 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-3c6aa02d-c49a-4fe4-ae76-34faaf7550b1 req-d2a3b5de-28b5-45e7-b6d8-88030e9cad3d service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:42.998331 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-3c6aa02d-c49a-4fe4-ae76-34faaf7550b1 req-d2a3b5de-28b5-45e7-b6d8-88030e9cad3d service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:43.009202 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-3c6aa02d-c49a-4fe4-ae76-34faaf7550b1 req-d2a3b5de-28b5-45e7-b6d8-88030e9cad3d service nova] Creating event network-vif-deleted:bb8defef-013e-4d49-8621-5b924722dedc for instance b39c466e-0f7f-48d9-accb-da8ecd932142 on hv-cinder-85083 Aug 03 13:07:43.013927 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-3c6aa02d-c49a-4fe4-ae76-34faaf7550b1 req-d2a3b5de-28b5-45e7-b6d8-88030e9cad3d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030256 Aug 03 13:07:43.014597 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 436/873] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:07:43.923693 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d75be128-5dd1-493a-930a-3be6a1d1e6cd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:43.924313 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d75be128-5dd1-493a-930a-3be6a1d1e6cd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:43.930815 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d75be128-5dd1-493a-930a-3be6a1d1e6cd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:43.931266 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d75be128-5dd1-493a-930a-3be6a1d1e6cd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:43.932031 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d75be128-5dd1-493a-930a-3be6a1d1e6cd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:43.932467 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d75be128-5dd1-493a-930a-3be6a1d1e6cd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:43.962992 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d75be128-5dd1-493a-930a-3be6a1d1e6cd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:43.963444 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d75be128-5dd1-493a-930a-3be6a1d1e6cd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:43.963936 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-d75be128-5dd1-493a-930a-3be6a1d1e6cd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lazy-loading 'fault' on Instance uuid b39c466e-0f7f-48d9-accb-da8ecd932142 {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:07:44.003790 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d75be128-5dd1-493a-930a-3be6a1d1e6cd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5f78a0ee0642c7bbde2ecf34e090d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1056fe005471f83a0633c99c0b349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:07:44.010571 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d75be128-5dd1-493a-930a-3be6a1d1e6cd tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 200 len: 1312 microversion: 2.1 time: 0.090922 Aug 03 13:07:44.011719 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 438/874] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:07:43 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 1312 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:07:45.032378 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-664a2bc1-3f61-4620-bec2-3c3049752687 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:07:45.033061 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-664a2bc1-3f61-4620-bec2-3c3049752687 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] [instance: b39c466e-0f7f-48d9-accb-da8ecd932142] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:07:45.039463 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-664a2bc1-3f61-4620-bec2-3c3049752687 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:45.039903 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-664a2bc1-3f61-4620-bec2-3c3049752687 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:45.040643 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-664a2bc1-3f61-4620-bec2-3c3049752687 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:07:45.041068 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-664a2bc1-3f61-4620-bec2-3c3049752687 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:07:45.054351 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-664a2bc1-3f61-4620-bec2-3c3049752687 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] HTTP exception thrown: Instance b39c466e-0f7f-48d9-accb-da8ecd932142 could not be found. Aug 03 13:07:45.055933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-664a2bc1-3f61-4620-bec2-3c3049752687 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Request method failure captured: Aug 03 13:07:45.055933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 HTTP/1.1 Aug 03 13:07:45.055933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 13:07:45.055933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 13:07:45.055933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 13:07:45.055933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 0 Aug 03 13:07:45.055933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 13:07:45.055933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 13:07:45.055933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 13:07:45.055933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 13:07:45.055933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nEyeq1aA1DnWg7YkrE7D7bgGX9PT3-iXVy9M8Ibjz8s_-Ya_DEsxR7W_QOmRw1tPup_D6mHy2sBVRW5GVp8rEJSTe-zvtUT4dMGtJrZFsYShgkC-wDTETwNYIQHR5pBl-lDcgJcvGJPrB8PSIjI-ebaXTKQTexfbZ3prTy1VXvIMP0 Aug 03 13:07:45.055933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 13:07:45.055933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 13:07:45.055933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 13:07:45.055933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 13:07:45.055933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 13:07:45.055933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 13:07:45.055933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: 6be1056fe005471f83a0633c99c0b349 Aug 03 13:07:45.055933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1367109722 Aug 03 13:07:45.055933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 13:07:45.055933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 13:07:45.057453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6be1056fe005471f83a0633c99c0b349"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6be1056fe005471f83a0633c99c0b349"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6be1056fe005471f83a0633c99c0b349"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6be1056fe005471f83a0633c99c0b349", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:07:45.057453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1367109722 Aug 03 13:07:45.057453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: 6be1056fe005471f83a0633c99c0b349 Aug 03 13:07:45.057453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1367109722 Aug 03 13:07:45.057453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-ServerRescueNegativeTestJSON-1367109722-project Aug 03 13:07:45.057453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 13:07:45.057453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 13:07:45.057453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: bb5f78a0ee0642c7bbde2ecf34e090d0 Aug 03 13:07:45.057453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1367109722-project Aug 03 13:07:45.057453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: > Aug 03 13:07:45.057453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Instance b39c466e-0f7f-48d9-accb-da8ecd932142 could not be found. Aug 03 13:07:45.057453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'id': 'b39c466e-0f7f-48d9-accb-da8ecd932142'} Aug 03 13:07:45.058393 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:07:45.058393 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:07:45.058393 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:07:45.058393 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:07:45.058393 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:07:45.058393 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:07:45.058393 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:07:45.058393 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:07:45.058393 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:07:45.058393 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:07:45.058393 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b39c466e-0f7f-48d9-accb-da8ecd932142 could not be found. Aug 03 13:07:45.058393 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:07:45.058393 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:07:45.058393 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:07:45.058393 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:07:45.058393 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:07:45.058393 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:07:45.058393 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:07:45.058393 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:07:45.058393 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:07:45.059866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:07:45.059866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:07:45.059866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:07:45.059866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:07:45.059866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:07:45.059866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:07:45.059866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:07:45.059866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b39c466e-0f7f-48d9-accb-da8ecd932142 could not be found. Aug 03 13:07:45.059866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:07:45.059866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:07:45.059866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:07:45.059866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:07:45.059866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:07:45.059866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:07:45.059866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:07:45.059866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:07:45.059866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b39c466e-0f7f-48d9-accb-da8ecd932142 could not be found. Aug 03 13:07:45.059866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:07:45.061171 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-664a2bc1-3f61-4620-bec2-3c3049752687 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] Returning 404 to user: Instance b39c466e-0f7f-48d9-accb-da8ecd932142 could not be found. {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:07:45.061171 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-664a2bc1-3f61-4620-bec2-3c3049752687 tempest-ServerRescueNegativeTestJSON-1367109722 tempest-ServerRescueNegativeTestJSON-1367109722-project] 10.222.0.64 "GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142" status: 404 len: 111 microversion: 2.1 time: 0.029655 Aug 03 13:07:45.061171 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 437/875] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:07:45 2022] GET /compute/v2.1/servers/b39c466e-0f7f-48d9-accb-da8ecd932142 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:08:23.044717 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-138966cf-2346-41a4-8cad-a1ae5837095a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:23.045286 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-138966cf-2346-41a4-8cad-a1ae5837095a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:23.047338 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=2 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:23.047975 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:23.052679 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-138966cf-2346-41a4-8cad-a1ae5837095a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:23.053186 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-138966cf-2346-41a4-8cad-a1ae5837095a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:23.053938 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-138966cf-2346-41a4-8cad-a1ae5837095a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:23.054388 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-138966cf-2346-41a4-8cad-a1ae5837095a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:23.080477 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-138966cf-2346-41a4-8cad-a1ae5837095a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1/ips" status: 200 len: 149 microversion: 2.1 time: 0.039871 Aug 03 13:08:23.081025 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 439/876] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Aug 3 13:08:23 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:08:26.787907 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d174f35f-f34f-4fbe-9f54-ab0ece375274 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33eb43fc-64c8-4d11-95c3-6ae5b32b7de1"}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:08:26.790303 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-d174f35f-f34f-4fbe-9f54-ab0ece375274 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:26.793100 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=11 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:26.793886 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=80 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:26.801186 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d174f35f-f34f-4fbe-9f54-ab0ece375274 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:26.802951 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d174f35f-f34f-4fbe-9f54-ab0ece375274 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:26.802951 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d174f35f-f34f-4fbe-9f54-ab0ece375274 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:26.802951 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d174f35f-f34f-4fbe-9f54-ab0ece375274 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:28.637868 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-27b53d5f-ff88-4fcc-9713-ebd59cca10e2 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:28.638368 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-27b53d5f-ff88-4fcc-9713-ebd59cca10e2 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:28.645389 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-27b53d5f-ff88-4fcc-9713-ebd59cca10e2 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:28.645837 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-27b53d5f-ff88-4fcc-9713-ebd59cca10e2 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:28.646592 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-27b53d5f-ff88-4fcc-9713-ebd59cca10e2 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:28.647060 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-27b53d5f-ff88-4fcc-9713-ebd59cca10e2 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:28.672060 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-27b53d5f-ff88-4fcc-9713-ebd59cca10e2 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Going to try to terminate instance {{(pid=119410) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 13:08:28.952693 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-27b53d5f-ff88-4fcc-9713-ebd59cca10e2 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "DELETE /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 204 len: 0 microversion: 2.1 time: 0.318850 Aug 03 13:08:28.953283 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 440/877] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 3 13:08:28 2022] DELETE /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 13:08:28.961561 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-b8677680-5acf-4108-b194-b1fcfd37f425 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:28.962247 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-b8677680-5acf-4108-b194-b1fcfd37f425 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:28.968709 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b8677680-5acf-4108-b194-b1fcfd37f425 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:28.969153 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b8677680-5acf-4108-b194-b1fcfd37f425 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:28.969907 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b8677680-5acf-4108-b194-b1fcfd37f425 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:28.970336 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b8677680-5acf-4108-b194-b1fcfd37f425 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:29.100068 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-b8677680-5acf-4108-b194-b1fcfd37f425 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:29.107649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-b8677680-5acf-4108-b194-b1fcfd37f425 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1577 microversion: 2.1 time: 0.150073 Aug 03 13:08:29.108213 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 441/878] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:28 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:08:30.127980 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-20877ce6-4741-42c2-991b-4705429e28f7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:30.128659 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-20877ce6-4741-42c2-991b-4705429e28f7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:30.135138 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-20877ce6-4741-42c2-991b-4705429e28f7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:30.136109 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-20877ce6-4741-42c2-991b-4705429e28f7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:30.136859 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-20877ce6-4741-42c2-991b-4705429e28f7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:30.137298 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-20877ce6-4741-42c2-991b-4705429e28f7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:30.278559 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-20877ce6-4741-42c2-991b-4705429e28f7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:30.286517 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-20877ce6-4741-42c2-991b-4705429e28f7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1577 microversion: 2.1 time: 0.162336 Aug 03 13:08:30.287116 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 442/879] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:30 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:08:30.636642 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-d174f35f-f34f-4fbe-9f54-ab0ece375274 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "POST /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.852257 Aug 03 13:08:30.637278 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 438/880] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Aug 3 13:08:26 2022] POST /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1/os-volume_attachments => generated 194 bytes in 3854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:08:31.308228 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1733c3d2-1b72-4e29-ad8b-3f5199beaa14 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:31.308869 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-1733c3d2-1b72-4e29-ad8b-3f5199beaa14 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:31.316753 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1733c3d2-1b72-4e29-ad8b-3f5199beaa14 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:31.317392 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1733c3d2-1b72-4e29-ad8b-3f5199beaa14 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:31.318360 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1733c3d2-1b72-4e29-ad8b-3f5199beaa14 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:31.318833 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1733c3d2-1b72-4e29-ad8b-3f5199beaa14 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:31.458984 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-1733c3d2-1b72-4e29-ad8b-3f5199beaa14 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:31.467214 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-1733c3d2-1b72-4e29-ad8b-3f5199beaa14 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1577 microversion: 2.1 time: 0.163256 Aug 03 13:08:31.467763 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 443/881] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:31 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:08:32.490841 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-faae2b9a-2069-4fed-957e-f3313fffc3cc tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:32.491541 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-faae2b9a-2069-4fed-957e-f3313fffc3cc tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:32.498298 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-faae2b9a-2069-4fed-957e-f3313fffc3cc tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:32.498752 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-faae2b9a-2069-4fed-957e-f3313fffc3cc tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:32.499564 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-faae2b9a-2069-4fed-957e-f3313fffc3cc tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:32.499989 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-faae2b9a-2069-4fed-957e-f3313fffc3cc tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:32.630749 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-faae2b9a-2069-4fed-957e-f3313fffc3cc tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:32.638229 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-faae2b9a-2069-4fed-957e-f3313fffc3cc tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1577 microversion: 2.1 time: 0.151964 Aug 03 13:08:32.638809 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 439/882] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:32 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:08:33.659229 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-8e120e43-e0c5-40d3-8492-920cd43dd819 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:33.660134 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-8e120e43-e0c5-40d3-8492-920cd43dd819 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:33.666906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8e120e43-e0c5-40d3-8492-920cd43dd819 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:33.667364 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8e120e43-e0c5-40d3-8492-920cd43dd819 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:33.668137 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8e120e43-e0c5-40d3-8492-920cd43dd819 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:33.668572 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8e120e43-e0c5-40d3-8492-920cd43dd819 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:33.798096 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-8e120e43-e0c5-40d3-8492-920cd43dd819 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:33.805558 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-8e120e43-e0c5-40d3-8492-920cd43dd819 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1577 microversion: 2.1 time: 0.150232 Aug 03 13:08:33.806136 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 444/883] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:33 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:08:34.826727 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-34c2ea42-3ae6-49f4-aa32-7d1e82158cd7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:34.827354 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-34c2ea42-3ae6-49f4-aa32-7d1e82158cd7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:34.833706 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-34c2ea42-3ae6-49f4-aa32-7d1e82158cd7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:34.834146 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-34c2ea42-3ae6-49f4-aa32-7d1e82158cd7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:34.834931 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-34c2ea42-3ae6-49f4-aa32-7d1e82158cd7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:34.835363 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-34c2ea42-3ae6-49f4-aa32-7d1e82158cd7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:34.964742 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-34c2ea42-3ae6-49f4-aa32-7d1e82158cd7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:34.972376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-34c2ea42-3ae6-49f4-aa32-7d1e82158cd7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1577 microversion: 2.1 time: 0.149822 Aug 03 13:08:34.972873 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 440/884] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:34 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:08:35.993316 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-4b9c6d68-f6ef-4f37-8816-850208881a9a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:35.993916 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-4b9c6d68-f6ef-4f37-8816-850208881a9a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:36.000379 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4b9c6d68-f6ef-4f37-8816-850208881a9a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:36.000827 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4b9c6d68-f6ef-4f37-8816-850208881a9a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:36.001576 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4b9c6d68-f6ef-4f37-8816-850208881a9a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:36.002004 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4b9c6d68-f6ef-4f37-8816-850208881a9a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:36.153710 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-4b9c6d68-f6ef-4f37-8816-850208881a9a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:36.164572 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-4b9c6d68-f6ef-4f37-8816-850208881a9a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1577 microversion: 2.1 time: 0.172261 Aug 03 13:08:36.164572 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 445/885] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:35 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:08:36.988062 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-01b7509a-b638-4eac-a7c1-58f1218978b6 req-331ab512-5066-41f3-a69d-98b05758d664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d598c3-1b65-4871-b23f-ffb42f3551aa", "name": "network-vif-deleted", "tag": "7d6c0cd1-c2da-4bd5-9c58-1f68951fec25"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:08:37.006396 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-01b7509a-b638-4eac-a7c1-58f1218978b6 req-331ab512-5066-41f3-a69d-98b05758d664 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:37.006959 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-01b7509a-b638-4eac-a7c1-58f1218978b6 req-331ab512-5066-41f3-a69d-98b05758d664 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:37.021511 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-01b7509a-b638-4eac-a7c1-58f1218978b6 req-331ab512-5066-41f3-a69d-98b05758d664 service nova] Creating event network-vif-deleted:7d6c0cd1-c2da-4bd5-9c58-1f68951fec25 for instance b9d598c3-1b65-4871-b23f-ffb42f3551aa on hv-cinder-85083 Aug 03 13:08:37.028510 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-01b7509a-b638-4eac-a7c1-58f1218978b6 req-331ab512-5066-41f3-a69d-98b05758d664 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045374 Aug 03 13:08:37.028510 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 441/886] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:08:37.184659 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-22511546-e42e-4b0f-9dea-8a8425b11b27 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:37.186076 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-22511546-e42e-4b0f-9dea-8a8425b11b27 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:37.192712 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-22511546-e42e-4b0f-9dea-8a8425b11b27 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:37.193171 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-22511546-e42e-4b0f-9dea-8a8425b11b27 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:37.193944 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-22511546-e42e-4b0f-9dea-8a8425b11b27 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:37.194649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-22511546-e42e-4b0f-9dea-8a8425b11b27 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:37.260105 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-22511546-e42e-4b0f-9dea-8a8425b11b27 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:37.278266 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-22511546-e42e-4b0f-9dea-8a8425b11b27 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1509 microversion: 2.1 time: 0.098262 Aug 03 13:08:37.278867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 446/887] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:37 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1509 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:08:38.301627 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-c12a2ae3-eb8a-4440-b65a-4642feca1267 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:38.302334 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-c12a2ae3-eb8a-4440-b65a-4642feca1267 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:38.308685 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c12a2ae3-eb8a-4440-b65a-4642feca1267 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:38.311230 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c12a2ae3-eb8a-4440-b65a-4642feca1267 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:38.311230 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c12a2ae3-eb8a-4440-b65a-4642feca1267 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:38.311230 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c12a2ae3-eb8a-4440-b65a-4642feca1267 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:38.345670 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c12a2ae3-eb8a-4440-b65a-4642feca1267 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:38.346127 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c12a2ae3-eb8a-4440-b65a-4642feca1267 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:38.346619 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.objects.instance [None req-c12a2ae3-eb8a-4440-b65a-4642feca1267 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lazy-loading 'fault' on Instance uuid b9d598c3-1b65-4871-b23f-ffb42f3551aa {{(pid=119409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:08:38.391521 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-c12a2ae3-eb8a-4440-b65a-4642feca1267 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:38.397825 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-c12a2ae3-eb8a-4440-b65a-4642feca1267 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 200 len: 1229 microversion: 2.1 time: 0.100926 Aug 03 13:08:38.398388 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 442/888] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:38 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 1229 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:08:39.419889 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-48680dc7-8685-4ea7-acb1-c6d49b25197d tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:39.420532 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-48680dc7-8685-4ea7-acb1-c6d49b25197d tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:39.427438 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-48680dc7-8685-4ea7-acb1-c6d49b25197d tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:39.427880 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-48680dc7-8685-4ea7-acb1-c6d49b25197d tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:39.428629 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-48680dc7-8685-4ea7-acb1-c6d49b25197d tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:39.429058 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-48680dc7-8685-4ea7-acb1-c6d49b25197d tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:39.443112 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.wsgi [None req-48680dc7-8685-4ea7-acb1-c6d49b25197d tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] HTTP exception thrown: Instance b9d598c3-1b65-4871-b23f-ffb42f3551aa could not be found. Aug 03 13:08:39.444706 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-48680dc7-8685-4ea7-acb1-c6d49b25197d tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Request method failure captured: Aug 03 13:08:39.444706 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: request: GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa HTTP/1.1 Aug 03 13:08:39.444706 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept: application/json Aug 03 13:08:39.444706 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept-Encoding: identity Aug 03 13:08:39.444706 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Connection: close Aug 03 13:08:39.444706 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Length: 0 Aug 03 13:08:39.444706 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Type: application/json Aug 03 13:08:39.444706 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Host: 10.222.0.64 Aug 03 13:08:39.444706 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Openstack-System-Scope: None Aug 03 13:08:39.444706 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: User-Agent: python-urllib3/1.26.10 Aug 03 13:08:39.444706 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Auth-Token: gAAAAABi6nJ4BMxiM3qOr4MBFgilu-HzP9w6Z0P34I4SNv2Ei8q1YsRoFkVbCX-CvQirWaj_9sEHyPAtRXsB2UKF1AHES1D2CvG2OJdZd9TSXlKZyV7szIwANnyCCoTbAruFt5o_V3UrZ-qqMbnA3qqopgm-vDSnazYl4r9GPCsWSdilHdFD8iM Aug 03 13:08:39.444706 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Id: None Aug 03 13:08:39.444706 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Name: None Aug 03 13:08:39.444706 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Identity-Status: Confirmed Aug 03 13:08:39.444706 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Is-Admin-Project: True Aug 03 13:08:39.444706 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Id: default Aug 03 13:08:39.444706 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Name: Default Aug 03 13:08:39.444706 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Id: 5c182a81a1c64866944f21c4e26725a3 Aug 03 13:08:39.444706 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Name: tempest-TestVolumeBootPattern-62569797 Aug 03 13:08:39.444706 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Role: member,reader Aug 03 13:08:39.444706 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Roles: member,reader Aug 03 13:08:39.446250 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5c182a81a1c64866944f21c4e26725a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5c182a81a1c64866944f21c4e26725a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5c182a81a1c64866944f21c4e26725a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5c182a81a1c64866944f21c4e26725a3", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:08:39.446250 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant: tempest-TestVolumeBootPattern-62569797 Aug 03 13:08:39.446250 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Id: 5c182a81a1c64866944f21c4e26725a3 Aug 03 13:08:39.446250 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Name: tempest-TestVolumeBootPattern-62569797 Aug 03 13:08:39.446250 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User: tempest-TestVolumeBootPattern-62569797-project Aug 03 13:08:39.446250 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Id: default Aug 03 13:08:39.446250 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Name: Default Aug 03 13:08:39.446250 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Id: b2ccafac03aa420db7f76165f20b0d3b Aug 03 13:08:39.446250 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Name: tempest-TestVolumeBootPattern-62569797-project Aug 03 13:08:39.446250 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: method: > Aug 03 13:08:39.446250 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: exception: Instance b9d598c3-1b65-4871-b23f-ffb42f3551aa could not be found. Aug 03 13:08:39.446250 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: action_args: {'id': 'b9d598c3-1b65-4871-b23f-ffb42f3551aa'} Aug 03 13:08:39.447546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:08:39.447546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:08:39.447546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:08:39.447546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:08:39.447546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:08:39.447546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:08:39.447546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:08:39.447546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:08:39.447546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:08:39.447546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:08:39.447546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9d598c3-1b65-4871-b23f-ffb42f3551aa could not be found. Aug 03 13:08:39.447546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:08:39.447546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:08:39.447546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:08:39.447546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:08:39.447546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:08:39.447546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:08:39.447546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:08:39.447546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:08:39.447546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:08:39.449032 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:08:39.449032 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:08:39.449032 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:08:39.449032 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:08:39.449032 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:08:39.449032 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:08:39.449032 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:08:39.449032 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9d598c3-1b65-4871-b23f-ffb42f3551aa could not be found. Aug 03 13:08:39.449032 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:08:39.449032 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:08:39.449032 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:08:39.449032 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:08:39.449032 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:08:39.449032 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:08:39.449032 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:08:39.449032 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:08:39.449032 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9d598c3-1b65-4871-b23f-ffb42f3551aa could not be found. Aug 03 13:08:39.449032 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:08:39.450357 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-48680dc7-8685-4ea7-acb1-c6d49b25197d tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Returning 404 to user: Instance b9d598c3-1b65-4871-b23f-ffb42f3551aa could not be found. {{(pid=119410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:08:39.450357 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-48680dc7-8685-4ea7-acb1-c6d49b25197d tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 404 len: 111 microversion: 2.1 time: 0.030543 Aug 03 13:08:39.450357 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 447/889] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:39 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:08:39.541116 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-cf825d59-d69b-4d9e-9923-6f4a870e4307 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1919007534", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-285932187", "security_groups": [{"name": "tempest-secgroup-smoke-1269265979"}], "block_device_mapping_v2": [{"uuid": "157199c7-a923-4769-8b05-f111c6cbfe77", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "31f3d8b1-aaa3-4a1b-acac-10a82d58c4cb"}]}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:08:39.656608 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.network.neutron [None req-cf825d59-d69b-4d9e-9923-6f4a870e4307 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] validate_networks() for [('31f3d8b1-aaa3-4a1b-acac-10a82d58c4cb', None, None, None, None, None)] {{(pid=119409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 13:08:40.030575 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-cf825d59-d69b-4d9e-9923-6f4a870e4307 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Flavor limits 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 13:08:40.031011 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-cf825d59-d69b-4d9e-9923-6f4a870e4307 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Image limits 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 13:08:40.031479 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-cf825d59-d69b-4d9e-9923-6f4a870e4307 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Flavor pref 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 13:08:40.031880 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-cf825d59-d69b-4d9e-9923-6f4a870e4307 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Image pref 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 13:08:40.032280 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-cf825d59-d69b-4d9e-9923-6f4a870e4307 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 13:08:40.041396 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-cf825d59-d69b-4d9e-9923-6f4a870e4307 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:40.041837 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-cf825d59-d69b-4d9e-9923-6f4a870e4307 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:40.042664 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-cf825d59-d69b-4d9e-9923-6f4a870e4307 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:40.043130 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-cf825d59-d69b-4d9e-9923-6f4a870e4307 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:40.059259 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-cf825d59-d69b-4d9e-9923-6f4a870e4307 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Getting quotas for project 5c182a81a1c64866944f21c4e26725a3. Resources: {'instances', 'ram', 'cores'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 13:08:40.063046 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-cf825d59-d69b-4d9e-9923-6f4a870e4307 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Getting quotas for user b2ccafac03aa420db7f76165f20b0d3b and project 5c182a81a1c64866944f21c4e26725a3. Resources: {'instances', 'ram', 'cores'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 13:08:40.119176 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-cf825d59-d69b-4d9e-9923-6f4a870e4307 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Going to run 1 instances... {{(pid=119409) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 13:08:40.121237 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-cf825d59-d69b-4d9e-9923-6f4a870e4307 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: eeb53552-b05d-4931-920f-b11bac28243b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='157199c7-a923-4769-8b05-f111c6cbfe77',volume_size=None,volume_type=None)] {{(pid=119409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 13:08:40.515791 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-cf825d59-d69b-4d9e-9923-6f4a870e4307 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.978444 Aug 03 13:08:40.516461 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 443/890] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 3 13:08:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 13:08:40.531660 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-6584bc5a-e6d6-41cf-858a-df868f1dd503 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:40.533500 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-6584bc5a-e6d6-41cf-858a-df868f1dd503 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: eeb53552-b05d-4931-920f-b11bac28243b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:40.587545 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-6584bc5a-e6d6-41cf-858a-df868f1dd503 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:40.594255 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-6584bc5a-e6d6-41cf-858a-df868f1dd503 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b" status: 200 len: 1094 microversion: 2.1 time: 0.066646 Aug 03 13:08:40.594845 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 448/891] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:40 2022] GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:08:41.615463 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-337711c7-5365-40b0-b4b6-589aa00d4ac0 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:41.616026 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-337711c7-5365-40b0-b4b6-589aa00d4ac0 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: eeb53552-b05d-4931-920f-b11bac28243b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:41.622181 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-337711c7-5365-40b0-b4b6-589aa00d4ac0 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:41.631969 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-337711c7-5365-40b0-b4b6-589aa00d4ac0 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:41.631969 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-337711c7-5365-40b0-b4b6-589aa00d4ac0 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:41.631969 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-337711c7-5365-40b0-b4b6-589aa00d4ac0 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:41.687097 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-337711c7-5365-40b0-b4b6-589aa00d4ac0 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:41.694659 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-337711c7-5365-40b0-b4b6-589aa00d4ac0 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b" status: 200 len: 1144 microversion: 2.1 time: 0.083785 Aug 03 13:08:41.695249 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 444/892] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:41 2022] GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:08:42.716539 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-756cbd24-4f71-4ade-bd3b-44f97be518c4 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:42.717979 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-756cbd24-4f71-4ade-bd3b-44f97be518c4 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: eeb53552-b05d-4931-920f-b11bac28243b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:42.725395 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-756cbd24-4f71-4ade-bd3b-44f97be518c4 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:42.725851 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-756cbd24-4f71-4ade-bd3b-44f97be518c4 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:42.726685 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-756cbd24-4f71-4ade-bd3b-44f97be518c4 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:42.727150 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-756cbd24-4f71-4ade-bd3b-44f97be518c4 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:42.787675 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-756cbd24-4f71-4ade-bd3b-44f97be518c4 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:42.795889 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-756cbd24-4f71-4ade-bd3b-44f97be518c4 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b" status: 200 len: 1210 microversion: 2.1 time: 0.083832 Aug 03 13:08:42.796454 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 449/893] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:42 2022] GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:08:43.817999 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ffb4b360-4949-4c0d-ae00-9fc176cdcb51 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:43.819166 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-ffb4b360-4949-4c0d-ae00-9fc176cdcb51 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: eeb53552-b05d-4931-920f-b11bac28243b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:43.827078 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ffb4b360-4949-4c0d-ae00-9fc176cdcb51 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:43.827529 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ffb4b360-4949-4c0d-ae00-9fc176cdcb51 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:43.828305 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ffb4b360-4949-4c0d-ae00-9fc176cdcb51 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:43.828739 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ffb4b360-4949-4c0d-ae00-9fc176cdcb51 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:44.020462 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ffb4b360-4949-4c0d-ae00-9fc176cdcb51 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:44.034181 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-ffb4b360-4949-4c0d-ae00-9fc176cdcb51 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b" status: 200 len: 1278 microversion: 2.1 time: 0.221156 Aug 03 13:08:44.036308 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 445/894] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:43 2022] GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b => generated 1278 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:08:44.534383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-f05e4bfa-882b-4b6f-bbe0-1e9ab823b24a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33eb43fc-64c8-4d11-95c3-6ae5b32b7de1"}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:08:44.537613 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-f05e4bfa-882b-4b6f-bbe0-1e9ab823b24a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:44.545489 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f05e4bfa-882b-4b6f-bbe0-1e9ab823b24a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:44.546359 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f05e4bfa-882b-4b6f-bbe0-1e9ab823b24a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:44.547092 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f05e4bfa-882b-4b6f-bbe0-1e9ab823b24a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:44.547538 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f05e4bfa-882b-4b6f-bbe0-1e9ab823b24a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:44.631638 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.wsgi [None req-f05e4bfa-882b-4b6f-bbe0-1e9ab823b24a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] HTTP exception thrown: Invalid volume: volume 33eb43fc-64c8-4d11-95c3-6ae5b32b7de1 is already attached to instances: fdddc591-873f-484c-ac08-022cdfd864c1 Aug 03 13:08:44.633270 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-f05e4bfa-882b-4b6f-bbe0-1e9ab823b24a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Request method failure captured: Aug 03 13:08:44.633270 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: request: POST /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1/os-volume_attachments HTTP/1.1 Aug 03 13:08:44.633270 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept: application/json Aug 03 13:08:44.633270 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept-Encoding: identity Aug 03 13:08:44.633270 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Connection: close Aug 03 13:08:44.633270 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Length: 74 Aug 03 13:08:44.633270 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Type: application/json Aug 03 13:08:44.633270 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Host: 10.222.0.64 Aug 03 13:08:44.633270 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Openstack-System-Scope: None Aug 03 13:08:44.633270 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: User-Agent: python-urllib3/1.26.10 Aug 03 13:08:44.633270 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Auth-Token: gAAAAABi6nE7DMH7_yawRG_EFqNprJ7tBLEAekyvd1TBnPLfkLY5FE_9FrSgGLljSycXdPTf3Im9G-ykq7spGFlIg47_VU_2Fobyvwk0dbllyHhXgHfuZGQytAsHHqjzEzu1SvE5rruA2LuPS1Zi7AyBd0EQ49IEVy0pbvx8Z15H7rrkhk-6aqQ Aug 03 13:08:44.633270 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Id: None Aug 03 13:08:44.633270 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Name: None Aug 03 13:08:44.633270 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Identity-Status: Confirmed Aug 03 13:08:44.633270 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Is-Admin-Project: True Aug 03 13:08:44.633270 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Id: default Aug 03 13:08:44.633270 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Name: Default Aug 03 13:08:44.633270 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Id: 23cfcb8de5e448b8af185376a035263b Aug 03 13:08:44.633270 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Name: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:08:44.633270 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Role: member,reader Aug 03 13:08:44.633270 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Roles: member,reader Aug 03 13:08:44.637642 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_23cfcb8de5e448b8af185376a035263b", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:08:44.637642 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:08:44.637642 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Id: 23cfcb8de5e448b8af185376a035263b Aug 03 13:08:44.637642 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:08:44.637642 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User: tempest-AttachVolumeNegativeTest-1034317644-project Aug 03 13:08:44.637642 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Id: default Aug 03 13:08:44.637642 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Name: Default Aug 03 13:08:44.637642 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Id: 36693fa42a7b41279c8d8c59ecafb243 Aug 03 13:08:44.637642 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Name: tempest-AttachVolumeNegativeTest-1034317644-project Aug 03 13:08:44.637642 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Aug 03 13:08:44.637642 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: {"volumeAttachment": {"volumeId": "33eb43fc-64c8-4d11-95c3-6ae5b32b7de1"}} Aug 03 13:08:44.637642 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: method: > Aug 03 13:08:44.638477 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: exception: Invalid volume: volume 33eb43fc-64c8-4d11-95c3-6ae5b32b7de1 is already attached to instances: fdddc591-873f-484c-ac08-022cdfd864c1 Aug 03 13:08:44.638477 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: action_args: {'server_id': 'fdddc591-873f-484c-ac08-022cdfd864c1', 'body': {'volumeAttachment': {'volumeId': '33eb43fc-64c8-4d11-95c3-6ae5b32b7de1'}}} Aug 03 13:08:44.638477 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:08:44.638477 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:08:44.638477 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 03 13:08:44.638477 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 03 13:08:44.638477 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 13:08:44.638477 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 13:08:44.638477 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 13:08:44.638477 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 13:08:44.638477 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 03 13:08:44.638477 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 03 13:08:44.638477 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 03 13:08:44.638477 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 03 13:08:44.638477 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 33eb43fc-64c8-4d11-95c3-6ae5b32b7de1 is already attached to instances: fdddc591-873f-484c-ac08-022cdfd864c1 Aug 03 13:08:44.638477 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:08:44.638477 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:08:44.638477 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:08:44.638477 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:08:44.639923 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:08:44.639923 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:08:44.639923 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:08:44.639923 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:08:44.639923 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:08:44.639923 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:08:44.639923 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 13:08:44.639923 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 13:08:44.639923 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 13:08:44.639923 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 13:08:44.639923 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 13:08:44.639923 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 13:08:44.639923 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 03 13:08:44.639923 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 13:08:44.639923 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 33eb43fc-64c8-4d11-95c3-6ae5b32b7de1 is already attached to instances: fdddc591-873f-484c-ac08-022cdfd864c1 Aug 03 13:08:44.639923 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:08:44.639923 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:08:44.639923 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:08:44.639923 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:08:44.639923 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:08:44.641410 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:08:44.641410 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:08:44.641410 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:08:44.641410 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 33eb43fc-64c8-4d11-95c3-6ae5b32b7de1 is already attached to instances: fdddc591-873f-484c-ac08-022cdfd864c1 Aug 03 13:08:44.641410 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:08:44.641410 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-f05e4bfa-882b-4b6f-bbe0-1e9ab823b24a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Returning 400 to user: Invalid volume: volume 33eb43fc-64c8-4d11-95c3-6ae5b32b7de1 is already attached to instances: fdddc591-873f-484c-ac08-022cdfd864c1 {{(pid=119410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:08:44.641410 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-f05e4bfa-882b-4b6f-bbe0-1e9ab823b24a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "POST /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104483 Aug 03 13:08:44.641410 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 450/895] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Aug 3 13:08:44 2022] POST /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 13:08:44.704908 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-12d81d10-efda-4439-920b-617103513a4f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:44.705411 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-12d81d10-efda-4439-920b-617103513a4f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:44.711344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-12d81d10-efda-4439-920b-617103513a4f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:44.711851 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-12d81d10-efda-4439-920b-617103513a4f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:44.712620 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-12d81d10-efda-4439-920b-617103513a4f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:44.713124 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-12d81d10-efda-4439-920b-617103513a4f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:44.766323 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-2085b78e-8c22-4aba-ab08-7da684094510 req-8bfd0753-0450-46e3-93f6-e043ceed30d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeb53552-b05d-4931-920f-b11bac28243b", "tag": "1db7a902-7951-431f-9eb7-e35311be4427"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:08:44.780991 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-2085b78e-8c22-4aba-ab08-7da684094510 req-8bfd0753-0450-46e3-93f6-e043ceed30d3 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:44.781630 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-2085b78e-8c22-4aba-ab08-7da684094510 req-8bfd0753-0450-46e3-93f6-e043ceed30d3 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:44.793614 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-2085b78e-8c22-4aba-ab08-7da684094510 req-8bfd0753-0450-46e3-93f6-e043ceed30d3 service nova] Creating event network-changed:1db7a902-7951-431f-9eb7-e35311be4427 for instance eeb53552-b05d-4931-920f-b11bac28243b on hv-cinder-85083 Aug 03 13:08:44.798908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-2085b78e-8c22-4aba-ab08-7da684094510 req-8bfd0753-0450-46e3-93f6-e043ceed30d3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036488 Aug 03 13:08:44.800838 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 451/896] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:08:44.820332 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.objects.instance [None req-12d81d10-efda-4439-920b-617103513a4f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lazy-loading 'services' on Instance uuid fdddc591-873f-484c-ac08-022cdfd864c1 {{(pid=119409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:08:45.057726 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-315fd740-ec68-4f18-8e57-e8a44d5e72a1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:45.058622 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-315fd740-ec68-4f18-8e57-e8a44d5e72a1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: eeb53552-b05d-4931-920f-b11bac28243b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:45.066656 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-315fd740-ec68-4f18-8e57-e8a44d5e72a1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:45.067468 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-315fd740-ec68-4f18-8e57-e8a44d5e72a1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:45.068605 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-315fd740-ec68-4f18-8e57-e8a44d5e72a1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:45.069325 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-315fd740-ec68-4f18-8e57-e8a44d5e72a1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:45.069872 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-12d81d10-efda-4439-920b-617103513a4f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "DELETE /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1/os-volume_attachments/33eb43fc-64c8-4d11-95c3-6ae5b32b7de1" status: 202 len: 0 microversion: 2.1 time: 0.368715 Aug 03 13:08:45.070713 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 446/897] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Aug 3 13:08:44 2022] DELETE /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1/os-volume_attachments/33eb43fc-64c8-4d11-95c3-6ae5b32b7de1 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 13:08:45.082169 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-025408c9-2be9-4816-b14e-3d1b3cf7eeea tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:45.085166 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-025408c9-2be9-4816-b14e-3d1b3cf7eeea tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:45.093599 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-025408c9-2be9-4816-b14e-3d1b3cf7eeea tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:45.094135 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-025408c9-2be9-4816-b14e-3d1b3cf7eeea tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:45.096879 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-025408c9-2be9-4816-b14e-3d1b3cf7eeea tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:45.099906 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-025408c9-2be9-4816-b14e-3d1b3cf7eeea tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:45.132829 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-025408c9-2be9-4816-b14e-3d1b3cf7eeea tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055227 Aug 03 13:08:45.133419 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 447/898] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 3 13:08:45 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:08:45.237953 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-315fd740-ec68-4f18-8e57-e8a44d5e72a1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:45.248390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-315fd740-ec68-4f18-8e57-e8a44d5e72a1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b" status: 200 len: 1278 microversion: 2.1 time: 0.195215 Aug 03 13:08:45.249748 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 452/899] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:45 2022] GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b => generated 1278 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:08:46.146121 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-18ed7289-7278-47fa-b808-b50ad1460910 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:46.149070 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-18ed7289-7278-47fa-b808-b50ad1460910 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:46.156739 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-18ed7289-7278-47fa-b808-b50ad1460910 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:46.157435 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-18ed7289-7278-47fa-b808-b50ad1460910 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:46.158259 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-18ed7289-7278-47fa-b808-b50ad1460910 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:46.159273 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-18ed7289-7278-47fa-b808-b50ad1460910 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:46.187845 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-18ed7289-7278-47fa-b808-b50ad1460910 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046054 Aug 03 13:08:46.188329 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 448/900] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 3 13:08:46 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:08:46.269537 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-771cef9a-a925-4d95-aae9-9dc15a8fc58c tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:46.270200 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-771cef9a-a925-4d95-aae9-9dc15a8fc58c tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: eeb53552-b05d-4931-920f-b11bac28243b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:46.277451 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-771cef9a-a925-4d95-aae9-9dc15a8fc58c tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:46.277908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-771cef9a-a925-4d95-aae9-9dc15a8fc58c tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:46.278679 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-771cef9a-a925-4d95-aae9-9dc15a8fc58c tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:46.279171 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-771cef9a-a925-4d95-aae9-9dc15a8fc58c tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:46.410068 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-771cef9a-a925-4d95-aae9-9dc15a8fc58c tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:46.417608 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-771cef9a-a925-4d95-aae9-9dc15a8fc58c tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b" status: 200 len: 1266 microversion: 2.1 time: 0.151925 Aug 03 13:08:46.418169 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 453/901] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:46 2022] GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:08:47.200023 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-db4cf899-de4a-4fb2-9529-6a9142af276c tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:47.202184 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-db4cf899-de4a-4fb2-9529-6a9142af276c tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:47.208743 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-db4cf899-de4a-4fb2-9529-6a9142af276c tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:47.209197 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-db4cf899-de4a-4fb2-9529-6a9142af276c tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:47.209957 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-db4cf899-de4a-4fb2-9529-6a9142af276c tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:47.210391 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-db4cf899-de4a-4fb2-9529-6a9142af276c tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:47.239152 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-db4cf899-de4a-4fb2-9529-6a9142af276c tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043027 Aug 03 13:08:47.239696 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 449/902] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 3 13:08:47 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 13:08:47.302233 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-a78e07f4-47f4-43ed-9fe8-ae5e5a4d9804 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:47.302720 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-a78e07f4-47f4-43ed-9fe8-ae5e5a4d9804 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:47.309358 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a78e07f4-47f4-43ed-9fe8-ae5e5a4d9804 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:47.309811 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a78e07f4-47f4-43ed-9fe8-ae5e5a4d9804 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:47.310605 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a78e07f4-47f4-43ed-9fe8-ae5e5a4d9804 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:47.311135 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a78e07f4-47f4-43ed-9fe8-ae5e5a4d9804 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:47.335543 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-a78e07f4-47f4-43ed-9fe8-ae5e5a4d9804 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Going to try to terminate instance {{(pid=119410) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 13:08:47.438044 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-9378a974-58cc-428c-8ed5-da8ee7f360f1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:47.438654 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-9378a974-58cc-428c-8ed5-da8ee7f360f1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: eeb53552-b05d-4931-920f-b11bac28243b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:47.444733 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9378a974-58cc-428c-8ed5-da8ee7f360f1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:47.445177 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9378a974-58cc-428c-8ed5-da8ee7f360f1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:47.445929 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9378a974-58cc-428c-8ed5-da8ee7f360f1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:47.446357 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9378a974-58cc-428c-8ed5-da8ee7f360f1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:47.473217 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:47.583676 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-9378a974-58cc-428c-8ed5-da8ee7f360f1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:47.592056 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-9378a974-58cc-428c-8ed5-da8ee7f360f1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b" status: 200 len: 1266 microversion: 2.1 time: 0.157831 Aug 03 13:08:47.592634 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 450/903] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:47 2022] GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:08:47.605989 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-a78e07f4-47f4-43ed-9fe8-ae5e5a4d9804 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "DELETE /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1" status: 204 len: 0 microversion: 2.1 time: 0.307307 Aug 03 13:08:47.606565 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 454/904] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 3 13:08:47 2022] DELETE /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 13:08:47.614375 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-b444e23c-dc05-480a-969c-a8df045e1661 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:47.615021 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-b444e23c-dc05-480a-969c-a8df045e1661 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:47.621009 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b444e23c-dc05-480a-969c-a8df045e1661 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:47.621460 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b444e23c-dc05-480a-969c-a8df045e1661 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:47.622240 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b444e23c-dc05-480a-969c-a8df045e1661 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:47.622657 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b444e23c-dc05-480a-969c-a8df045e1661 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:47.756996 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b444e23c-dc05-480a-969c-a8df045e1661 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:47.765251 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-b444e23c-dc05-480a-969c-a8df045e1661 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1" status: 200 len: 1681 microversion: 2.1 time: 0.154531 Aug 03 13:08:47.765809 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 451/905] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:47 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:08:48.613091 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-9cfe18c9-2656-4bcb-9b13-80bd1121a14c tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:48.613807 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-9cfe18c9-2656-4bcb-9b13-80bd1121a14c tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: eeb53552-b05d-4931-920f-b11bac28243b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:48.620724 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9cfe18c9-2656-4bcb-9b13-80bd1121a14c tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:48.621166 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9cfe18c9-2656-4bcb-9b13-80bd1121a14c tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:48.621914 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9cfe18c9-2656-4bcb-9b13-80bd1121a14c tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:48.622343 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9cfe18c9-2656-4bcb-9b13-80bd1121a14c tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:48.758801 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-9cfe18c9-2656-4bcb-9b13-80bd1121a14c tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:48.762720 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-9cfe18c9-2656-4bcb-9b13-80bd1121a14c tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b" status: 200 len: 1266 microversion: 2.1 time: 0.153804 Aug 03 13:08:48.763322 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 455/906] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:48 2022] GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:08:48.786182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-2d19f538-935d-4c8c-8e7f-f16ff0a7eba8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:48.786825 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-2d19f538-935d-4c8c-8e7f-f16ff0a7eba8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:48.794492 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2d19f538-935d-4c8c-8e7f-f16ff0a7eba8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:48.794991 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2d19f538-935d-4c8c-8e7f-f16ff0a7eba8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:48.795752 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2d19f538-935d-4c8c-8e7f-f16ff0a7eba8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:48.796183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2d19f538-935d-4c8c-8e7f-f16ff0a7eba8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:48.924880 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-2d19f538-935d-4c8c-8e7f-f16ff0a7eba8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:48.932616 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-2d19f538-935d-4c8c-8e7f-f16ff0a7eba8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1" status: 200 len: 1681 microversion: 2.1 time: 0.150549 Aug 03 13:08:48.933230 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 452/907] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:48 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:08:49.783589 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-105bd233-5ae4-4a78-a699-0e787739d2dc tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:49.784236 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-105bd233-5ae4-4a78-a699-0e787739d2dc tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: eeb53552-b05d-4931-920f-b11bac28243b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:49.790991 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-105bd233-5ae4-4a78-a699-0e787739d2dc tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:49.791443 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-105bd233-5ae4-4a78-a699-0e787739d2dc tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:49.792211 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-105bd233-5ae4-4a78-a699-0e787739d2dc tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:49.793140 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-105bd233-5ae4-4a78-a699-0e787739d2dc tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:49.924508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-105bd233-5ae4-4a78-a699-0e787739d2dc tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:49.931991 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-105bd233-5ae4-4a78-a699-0e787739d2dc tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b" status: 200 len: 1266 microversion: 2.1 time: 0.152307 Aug 03 13:08:49.932562 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 456/908] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:49 2022] GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:08:49.953237 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-5118678d-a8a2-4be0-a08f-7185e333c04a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:49.953844 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-5118678d-a8a2-4be0-a08f-7185e333c04a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:49.960273 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5118678d-a8a2-4be0-a08f-7185e333c04a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:49.960744 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5118678d-a8a2-4be0-a08f-7185e333c04a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:49.961603 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5118678d-a8a2-4be0-a08f-7185e333c04a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:49.962031 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5118678d-a8a2-4be0-a08f-7185e333c04a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:49.980874 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:50.050611 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell0:SELECT=2 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:50.069612 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell0:SELECT=6 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:50.096649 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-5118678d-a8a2-4be0-a08f-7185e333c04a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:50.104852 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-5118678d-a8a2-4be0-a08f-7185e333c04a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1" status: 200 len: 1681 microversion: 2.1 time: 0.155425 Aug 03 13:08:50.106026 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 453/909] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:49 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:08:50.954133 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e1285645-3017-43c1-b6de-d05420cedc83 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:50.954792 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-e1285645-3017-43c1-b6de-d05420cedc83 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: eeb53552-b05d-4931-920f-b11bac28243b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:50.957743 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=2 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:50.961765 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e1285645-3017-43c1-b6de-d05420cedc83 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:50.962216 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e1285645-3017-43c1-b6de-d05420cedc83 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:50.963004 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e1285645-3017-43c1-b6de-d05420cedc83 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:50.963439 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e1285645-3017-43c1-b6de-d05420cedc83 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:51.092157 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-e1285645-3017-43c1-b6de-d05420cedc83 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:51.099709 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-e1285645-3017-43c1-b6de-d05420cedc83 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b" status: 200 len: 1266 microversion: 2.1 time: 0.149409 Aug 03 13:08:51.100303 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 457/910] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:50 2022] GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:08:51.127027 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-2eb1a601-5df9-44e3-bee1-bf9defcd0b66 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:51.127644 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-2eb1a601-5df9-44e3-bee1-bf9defcd0b66 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:51.134581 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2eb1a601-5df9-44e3-bee1-bf9defcd0b66 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:51.135063 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2eb1a601-5df9-44e3-bee1-bf9defcd0b66 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:51.135823 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2eb1a601-5df9-44e3-bee1-bf9defcd0b66 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:51.136860 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2eb1a601-5df9-44e3-bee1-bf9defcd0b66 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:51.269073 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-2eb1a601-5df9-44e3-bee1-bf9defcd0b66 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:51.276752 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-2eb1a601-5df9-44e3-bee1-bf9defcd0b66 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1" status: 200 len: 1681 microversion: 2.1 time: 0.153626 Aug 03 13:08:51.277308 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 454/911] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:51 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:08:52.120802 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d5b2bb53-d2c6-4def-8171-2c864892a33b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:52.121357 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d5b2bb53-d2c6-4def-8171-2c864892a33b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: eeb53552-b05d-4931-920f-b11bac28243b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:52.127786 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d5b2bb53-d2c6-4def-8171-2c864892a33b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:52.128320 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d5b2bb53-d2c6-4def-8171-2c864892a33b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:52.129085 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d5b2bb53-d2c6-4def-8171-2c864892a33b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:52.129511 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d5b2bb53-d2c6-4def-8171-2c864892a33b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:52.262369 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d5b2bb53-d2c6-4def-8171-2c864892a33b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:52.269941 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d5b2bb53-d2c6-4def-8171-2c864892a33b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b" status: 200 len: 1266 microversion: 2.1 time: 0.153138 Aug 03 13:08:52.270510 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 458/912] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:52 2022] GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:08:52.298523 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ec02024c-62e5-494e-819e-2531d28db361 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:52.299218 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-ec02024c-62e5-494e-819e-2531d28db361 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:52.305641 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ec02024c-62e5-494e-819e-2531d28db361 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:52.306088 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ec02024c-62e5-494e-819e-2531d28db361 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:52.306906 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ec02024c-62e5-494e-819e-2531d28db361 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:52.307342 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ec02024c-62e5-494e-819e-2531d28db361 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:52.441332 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ec02024c-62e5-494e-819e-2531d28db361 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:52.449455 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-ec02024c-62e5-494e-819e-2531d28db361 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1" status: 200 len: 1681 microversion: 2.1 time: 0.154055 Aug 03 13:08:52.450022 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 455/913] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:52 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:08:53.289815 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-ab7e6774-e54f-4a1e-b1d0-1f974e4e9e26 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:53.290533 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-ab7e6774-e54f-4a1e-b1d0-1f974e4e9e26 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: eeb53552-b05d-4931-920f-b11bac28243b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:53.297615 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ab7e6774-e54f-4a1e-b1d0-1f974e4e9e26 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:53.298026 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ab7e6774-e54f-4a1e-b1d0-1f974e4e9e26 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:53.298808 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ab7e6774-e54f-4a1e-b1d0-1f974e4e9e26 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:53.299244 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ab7e6774-e54f-4a1e-b1d0-1f974e4e9e26 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:53.430721 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ab7e6774-e54f-4a1e-b1d0-1f974e4e9e26 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:53.438150 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-ab7e6774-e54f-4a1e-b1d0-1f974e4e9e26 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b" status: 200 len: 1266 microversion: 2.1 time: 0.152079 Aug 03 13:08:53.438713 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 459/914] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:53 2022] GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:08:53.469860 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-4c5c2094-8d82-4191-bd62-296ac0b04658 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:53.470469 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-4c5c2094-8d82-4191-bd62-296ac0b04658 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:53.477025 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4c5c2094-8d82-4191-bd62-296ac0b04658 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:53.477473 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4c5c2094-8d82-4191-bd62-296ac0b04658 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:53.478247 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4c5c2094-8d82-4191-bd62-296ac0b04658 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:53.478687 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4c5c2094-8d82-4191-bd62-296ac0b04658 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:53.606198 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-4c5c2094-8d82-4191-bd62-296ac0b04658 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:53.613587 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-4c5c2094-8d82-4191-bd62-296ac0b04658 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1" status: 200 len: 1681 microversion: 2.1 time: 0.147517 Aug 03 13:08:53.614138 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 456/915] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:53 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:08:54.458455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-f960c64f-c349-415e-be06-5f5c7813350d tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:54.459088 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-f960c64f-c349-415e-be06-5f5c7813350d tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: eeb53552-b05d-4931-920f-b11bac28243b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:54.465630 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f960c64f-c349-415e-be06-5f5c7813350d tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:54.466075 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f960c64f-c349-415e-be06-5f5c7813350d tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:54.466848 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f960c64f-c349-415e-be06-5f5c7813350d tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:54.467285 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f960c64f-c349-415e-be06-5f5c7813350d tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:54.622467 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-f960c64f-c349-415e-be06-5f5c7813350d tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:54.632477 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-f960c64f-c349-415e-be06-5f5c7813350d tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b" status: 200 len: 1266 microversion: 2.1 time: 0.177904 Aug 03 13:08:54.636646 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-94515a83-1914-4216-8ae3-b3bd99b58c9a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:54.636646 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-94515a83-1914-4216-8ae3-b3bd99b58c9a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:54.637745 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 460/916] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:54 2022] GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:08:54.655058 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-94515a83-1914-4216-8ae3-b3bd99b58c9a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:54.655665 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-94515a83-1914-4216-8ae3-b3bd99b58c9a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:54.656752 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-94515a83-1914-4216-8ae3-b3bd99b58c9a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:54.657690 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-94515a83-1914-4216-8ae3-b3bd99b58c9a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:54.734435 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-94515a83-1914-4216-8ae3-b3bd99b58c9a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:54.744704 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-94515a83-1914-4216-8ae3-b3bd99b58c9a tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1" status: 200 len: 1613 microversion: 2.1 time: 0.113374 Aug 03 13:08:54.745652 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 457/917] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:54 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 => generated 1613 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:08:55.063646 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-6e43cbf9-fd56-4954-bcc6-bc6a25f1c7d2 req-3d0d301a-a3ff-4c4b-8173-33db16dd492c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdddc591-873f-484c-ac08-022cdfd864c1", "name": "network-vif-deleted", "tag": "7f9c7e63-c467-4d5b-b0fa-1fc75725b588"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:08:55.073267 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-6e43cbf9-fd56-4954-bcc6-bc6a25f1c7d2 req-3d0d301a-a3ff-4c4b-8173-33db16dd492c service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:55.074246 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-6e43cbf9-fd56-4954-bcc6-bc6a25f1c7d2 req-3d0d301a-a3ff-4c4b-8173-33db16dd492c service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:55.085724 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-6e43cbf9-fd56-4954-bcc6-bc6a25f1c7d2 req-3d0d301a-a3ff-4c4b-8173-33db16dd492c service nova] Creating event network-vif-deleted:7f9c7e63-c467-4d5b-b0fa-1fc75725b588 for instance fdddc591-873f-484c-ac08-022cdfd864c1 on hv-cinder-85083 Aug 03 13:08:55.092123 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-6e43cbf9-fd56-4954-bcc6-bc6a25f1c7d2 req-3d0d301a-a3ff-4c4b-8173-33db16dd492c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031983 Aug 03 13:08:55.092731 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 461/918] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:08:55.657979 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-f966e7a7-fa03-4e18-8e65-1bc79c7de6ae tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:55.658593 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-f966e7a7-fa03-4e18-8e65-1bc79c7de6ae tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: eeb53552-b05d-4931-920f-b11bac28243b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:55.665545 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f966e7a7-fa03-4e18-8e65-1bc79c7de6ae tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:55.665992 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f966e7a7-fa03-4e18-8e65-1bc79c7de6ae tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:55.666774 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f966e7a7-fa03-4e18-8e65-1bc79c7de6ae tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:55.667225 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f966e7a7-fa03-4e18-8e65-1bc79c7de6ae tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:55.767648 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-a4dc8f56-1d5e-4a9d-857d-66c9ffbab475 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:55.768350 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-a4dc8f56-1d5e-4a9d-857d-66c9ffbab475 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:55.783242 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a4dc8f56-1d5e-4a9d-857d-66c9ffbab475 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:55.783242 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a4dc8f56-1d5e-4a9d-857d-66c9ffbab475 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:55.785833 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a4dc8f56-1d5e-4a9d-857d-66c9ffbab475 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:55.786277 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a4dc8f56-1d5e-4a9d-857d-66c9ffbab475 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:55.824584 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-f966e7a7-fa03-4e18-8e65-1bc79c7de6ae tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:55.838628 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-f966e7a7-fa03-4e18-8e65-1bc79c7de6ae tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b" status: 200 len: 1266 microversion: 2.1 time: 0.184396 Aug 03 13:08:55.840524 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 458/919] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:55 2022] GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:08:55.865988 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a4dc8f56-1d5e-4a9d-857d-66c9ffbab475 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:55.866771 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a4dc8f56-1d5e-4a9d-857d-66c9ffbab475 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:55.867549 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-a4dc8f56-1d5e-4a9d-857d-66c9ffbab475 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lazy-loading 'fault' on Instance uuid fdddc591-873f-484c-ac08-022cdfd864c1 {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:08:55.914919 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-a4dc8f56-1d5e-4a9d-857d-66c9ffbab475 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:55.926221 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-a4dc8f56-1d5e-4a9d-857d-66c9ffbab475 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1" status: 200 len: 1331 microversion: 2.1 time: 0.163111 Aug 03 13:08:55.926818 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 462/920] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:55 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 => generated 1331 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:08:56.860166 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-0516a5e6-a22f-4ca1-9a94-456c6eef6728 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:56.860781 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-0516a5e6-a22f-4ca1-9a94-456c6eef6728 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: eeb53552-b05d-4931-920f-b11bac28243b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:56.864174 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:56.867757 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0516a5e6-a22f-4ca1-9a94-456c6eef6728 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:56.868154 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0516a5e6-a22f-4ca1-9a94-456c6eef6728 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:56.868906 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0516a5e6-a22f-4ca1-9a94-456c6eef6728 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:56.869338 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0516a5e6-a22f-4ca1-9a94-456c6eef6728 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:56.949117 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-f14ca2ce-9aad-467a-b5c5-bcf91aca2fca tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:56.950104 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-f14ca2ce-9aad-467a-b5c5-bcf91aca2fca tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:56.957678 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f14ca2ce-9aad-467a-b5c5-bcf91aca2fca tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:56.958138 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f14ca2ce-9aad-467a-b5c5-bcf91aca2fca tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:56.958979 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f14ca2ce-9aad-467a-b5c5-bcf91aca2fca tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:56.959417 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-f14ca2ce-9aad-467a-b5c5-bcf91aca2fca tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:56.983930 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.wsgi [None req-f14ca2ce-9aad-467a-b5c5-bcf91aca2fca tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] HTTP exception thrown: Instance fdddc591-873f-484c-ac08-022cdfd864c1 could not be found. Aug 03 13:08:56.986252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-f14ca2ce-9aad-467a-b5c5-bcf91aca2fca tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Request method failure captured: Aug 03 13:08:56.986252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: request: GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 HTTP/1.1 Aug 03 13:08:56.986252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept: application/json Aug 03 13:08:56.986252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept-Encoding: identity Aug 03 13:08:56.986252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Connection: close Aug 03 13:08:56.986252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Length: 0 Aug 03 13:08:56.986252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Type: application/json Aug 03 13:08:56.986252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Host: 10.222.0.64 Aug 03 13:08:56.986252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Openstack-System-Scope: None Aug 03 13:08:56.986252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: User-Agent: python-urllib3/1.26.10 Aug 03 13:08:56.986252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Auth-Token: gAAAAABi6nE7DMH7_yawRG_EFqNprJ7tBLEAekyvd1TBnPLfkLY5FE_9FrSgGLljSycXdPTf3Im9G-ykq7spGFlIg47_VU_2Fobyvwk0dbllyHhXgHfuZGQytAsHHqjzEzu1SvE5rruA2LuPS1Zi7AyBd0EQ49IEVy0pbvx8Z15H7rrkhk-6aqQ Aug 03 13:08:56.986252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Id: None Aug 03 13:08:56.986252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Name: None Aug 03 13:08:56.986252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Identity-Status: Confirmed Aug 03 13:08:56.986252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Is-Admin-Project: True Aug 03 13:08:56.986252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Id: default Aug 03 13:08:56.986252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Name: Default Aug 03 13:08:56.986252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Id: 23cfcb8de5e448b8af185376a035263b Aug 03 13:08:56.986252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Name: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:08:56.986252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Role: member,reader Aug 03 13:08:56.986252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Roles: member,reader Aug 03 13:08:56.987666 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_23cfcb8de5e448b8af185376a035263b", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:08:56.987666 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:08:56.987666 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Id: 23cfcb8de5e448b8af185376a035263b Aug 03 13:08:56.987666 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:08:56.987666 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User: tempest-AttachVolumeNegativeTest-1034317644-project Aug 03 13:08:56.987666 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Id: default Aug 03 13:08:56.987666 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Name: Default Aug 03 13:08:56.987666 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Id: 36693fa42a7b41279c8d8c59ecafb243 Aug 03 13:08:56.987666 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Name: tempest-AttachVolumeNegativeTest-1034317644-project Aug 03 13:08:56.987666 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: method: > Aug 03 13:08:56.987666 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: exception: Instance fdddc591-873f-484c-ac08-022cdfd864c1 could not be found. Aug 03 13:08:56.987666 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: action_args: {'id': 'fdddc591-873f-484c-ac08-022cdfd864c1'} Aug 03 13:08:56.988390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:08:56.988390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:08:56.988390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:08:56.988390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:08:56.988390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:08:56.988390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:08:56.988390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:08:56.988390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:08:56.988390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:08:56.988390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:08:56.988390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdddc591-873f-484c-ac08-022cdfd864c1 could not be found. Aug 03 13:08:56.988390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:08:56.988390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:08:56.988390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:08:56.988390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:08:56.988390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:08:56.988390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:08:56.988390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:08:56.988390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:08:56.988390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:08:56.990491 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:08:56.990491 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:08:56.990491 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:08:56.990491 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:08:56.990491 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:08:56.990491 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:08:56.990491 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:08:56.990491 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdddc591-873f-484c-ac08-022cdfd864c1 could not be found. Aug 03 13:08:56.990491 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:08:56.990491 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:08:56.990491 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:08:56.990491 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:08:56.990491 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:08:56.990491 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:08:56.990491 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:08:56.990491 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:08:56.990491 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdddc591-873f-484c-ac08-022cdfd864c1 could not be found. Aug 03 13:08:56.990491 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:08:56.994062 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-f14ca2ce-9aad-467a-b5c5-bcf91aca2fca tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Returning 404 to user: Instance fdddc591-873f-484c-ac08-022cdfd864c1 could not be found. {{(pid=119410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:08:56.995144 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-f14ca2ce-9aad-467a-b5c5-bcf91aca2fca tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1" status: 404 len: 111 microversion: 2.1 time: 0.050608 Aug 03 13:08:56.995887 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 463/921] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:56 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:08:57.010302 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-3db40219-6f70-44d7-a0ae-a631ac4e230d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '.version_select at 0x7fe6d89d4790>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:57.015389 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-0516a5e6-a22f-4ca1-9a94-456c6eef6728 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:57.023291 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-0516a5e6-a22f-4ca1-9a94-456c6eef6728 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b" status: 200 len: 1266 microversion: 2.1 time: 0.167100 Aug 03 13:08:57.024120 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 459/922] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:56 2022] GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:08:57.029940 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-e74f95fb-f607-4651-90de-de66d52ab67f req-35cfaa5a-23a8-41d9-bed4-98d405fcb237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb53552-b05d-4931-920f-b11bac28243b", "name": "network-vif-plugged", "status": "completed", "tag": "1db7a902-7951-431f-9eb7-e35311be4427"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:08:57.039486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-e74f95fb-f607-4651-90de-de66d52ab67f req-35cfaa5a-23a8-41d9-bed4-98d405fcb237 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:57.039928 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-e74f95fb-f607-4651-90de-de66d52ab67f req-35cfaa5a-23a8-41d9-bed4-98d405fcb237 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:57.051568 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-e74f95fb-f607-4651-90de-de66d52ab67f req-35cfaa5a-23a8-41d9-bed4-98d405fcb237 service nova] Creating event network-vif-plugged:1db7a902-7951-431f-9eb7-e35311be4427 for instance eeb53552-b05d-4931-920f-b11bac28243b on hv-cinder-85083 Aug 03 13:08:57.056473 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-e74f95fb-f607-4651-90de-de66d52ab67f req-35cfaa5a-23a8-41d9-bed4-98d405fcb237 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030990 Aug 03 13:08:57.057076 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 460/923] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:08:57.149102 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-3db40219-6f70-44d7-a0ae-a631ac4e230d tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-102923756" status: 202 len: 0 microversion: 2.1 time: 0.148522 Aug 03 13:08:57.149903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 464/924] 10.222.0.64 () {58 vars in 1218 bytes} [Wed Aug 3 13:08:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-102923756 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 13:08:57.970448 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-70d1874d-ffce-4d5e-ba49-633a9b9d1858 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Action: 'create', calling method: .version_select at 0x7fe6d814b940>, body: {"keypair": {"name": "tempest-keypair-551060817", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIICFn/Avk9KBe4aS8oC63CG2OHPUgGUZVVS7rucmwWBpYsGASNM+X0bFDl8le96b0ji0Afr1CFQQd3VhM1zpfx3XvZ3d6t0rF3DJMfccnr0OxfViygpdbSwSEw/1Jyxvg=="}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:08:57.986478 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-70d1874d-ffce-4d5e-ba49-633a9b9d1858 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Getting quotas for project 23cfcb8de5e448b8af185376a035263b. Resources: {'key_pairs'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 13:08:57.990522 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-70d1874d-ffce-4d5e-ba49-633a9b9d1858 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Getting quotas for user 36693fa42a7b41279c8d8c59ecafb243 and project 23cfcb8de5e448b8af185376a035263b. Resources: {'key_pairs'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 13:08:58.045924 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-3a2eebbe-eb3c-48ae-b78a-5b6118ba4594 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:58.046540 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-3a2eebbe-eb3c-48ae-b78a-5b6118ba4594 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: eeb53552-b05d-4931-920f-b11bac28243b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:58.053387 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3a2eebbe-eb3c-48ae-b78a-5b6118ba4594 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:58.053839 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3a2eebbe-eb3c-48ae-b78a-5b6118ba4594 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:58.054641 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3a2eebbe-eb3c-48ae-b78a-5b6118ba4594 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:58.055109 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3a2eebbe-eb3c-48ae-b78a-5b6118ba4594 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:58.092116 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-70d1874d-ffce-4d5e-ba49-633a9b9d1858 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.126337 Aug 03 13:08:58.092740 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 461/925] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Aug 3 13:08:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:08:58.208803 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-3a2eebbe-eb3c-48ae-b78a-5b6118ba4594 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:58.216356 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-3a2eebbe-eb3c-48ae-b78a-5b6118ba4594 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b" status: 200 len: 1266 microversion: 2.1 time: 0.175416 Aug 03 13:08:58.216919 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 465/926] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:58 2022] GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:08:59.183594 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-8847a976-59e2-4db4-9060-05e8577b196d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:59.184232 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-8847a976-59e2-4db4-9060-05e8577b196d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:59.190368 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8847a976-59e2-4db4-9060-05e8577b196d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:59.190873 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8847a976-59e2-4db4-9060-05e8577b196d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:59.191636 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8847a976-59e2-4db4-9060-05e8577b196d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:59.192068 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8847a976-59e2-4db4-9060-05e8577b196d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:59.216711 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-8847a976-59e2-4db4-9060-05e8577b196d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7/ips" status: 200 len: 153 microversion: 2.20 time: 0.038062 Aug 03 13:08:59.222422 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 462/927] 10.222.0.64 () {60 vars in 1289 bytes} [Wed Aug 3 13:08:59 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7/ips => generated 153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 13:08:59.236080 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1643122d-1e92-40f1-941d-e00d6d0697b7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:08:59.236719 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-1643122d-1e92-40f1-941d-e00d6d0697b7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: eeb53552-b05d-4931-920f-b11bac28243b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:08:59.239314 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:59.244355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1643122d-1e92-40f1-941d-e00d6d0697b7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:59.246610 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1643122d-1e92-40f1-941d-e00d6d0697b7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:59.246610 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1643122d-1e92-40f1-941d-e00d6d0697b7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:08:59.246927 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1643122d-1e92-40f1-941d-e00d6d0697b7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:08:59.398378 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-1643122d-1e92-40f1-941d-e00d6d0697b7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:08:59.406095 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-1643122d-1e92-40f1-941d-e00d6d0697b7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b" status: 200 len: 1266 microversion: 2.1 time: 0.173800 Aug 03 13:08:59.408535 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 466/928] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:08:59 2022] GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:09:00.428190 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-7236b09e-6f65-41a7-9982-79f92a798c72 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:00.428798 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-7236b09e-6f65-41a7-9982-79f92a798c72 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: eeb53552-b05d-4931-920f-b11bac28243b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:00.435857 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7236b09e-6f65-41a7-9982-79f92a798c72 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:00.436479 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7236b09e-6f65-41a7-9982-79f92a798c72 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:00.445840 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7236b09e-6f65-41a7-9982-79f92a798c72 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:00.445840 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7236b09e-6f65-41a7-9982-79f92a798c72 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:00.616947 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-7236b09e-6f65-41a7-9982-79f92a798c72 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:00.627164 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-7236b09e-6f65-41a7-9982-79f92a798c72 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b" status: 200 len: 1452 microversion: 2.1 time: 0.202944 Aug 03 13:09:00.627668 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 463/929] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:00 2022] GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b => generated 1452 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:09:00.648939 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-2c3d1874-6fad-480e-9863-78273d3c5ef1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:00.649733 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-2c3d1874-6fad-480e-9863-78273d3c5ef1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: eeb53552-b05d-4931-920f-b11bac28243b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:00.658775 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2c3d1874-6fad-480e-9863-78273d3c5ef1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:00.659277 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2c3d1874-6fad-480e-9863-78273d3c5ef1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:00.660381 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2c3d1874-6fad-480e-9863-78273d3c5ef1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:00.660819 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2c3d1874-6fad-480e-9863-78273d3c5ef1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:00.809910 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-2c3d1874-6fad-480e-9863-78273d3c5ef1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:00.817742 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-2c3d1874-6fad-480e-9863-78273d3c5ef1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b" status: 200 len: 1452 microversion: 2.1 time: 0.173105 Aug 03 13:09:00.819199 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 467/930] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:00 2022] GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b => generated 1452 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:09:00.949325 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-495bc325-a96f-41a9-9ae8-a0922e15e562 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1493426831", "imageRef": "c0aabcc0-d4af-4f0e-b8a5-d140344fce1f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "62a2a8c1-4047-4249-9eca-1b469b6efbc6"}], "security_groups": [{"name": "tempest-securitygroup--1872663686"}], "key_name": "tempest-keypair-551060817", "user_data": "}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:09:01.129635 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.network.neutron [None req-495bc325-a96f-41a9-9ae8-a0922e15e562 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] validate_networks() for [('62a2a8c1-4047-4249-9eca-1b469b6efbc6', None, None, None, None, None)] {{(pid=119409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 13:09:01.997481 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-495bc325-a96f-41a9-9ae8-a0922e15e562 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Flavor limits 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 13:09:01.998435 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-495bc325-a96f-41a9-9ae8-a0922e15e562 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Image limits 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 13:09:01.999176 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-495bc325-a96f-41a9-9ae8-a0922e15e562 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Flavor pref 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 13:09:02.000051 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-495bc325-a96f-41a9-9ae8-a0922e15e562 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Image pref 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 13:09:02.000805 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-495bc325-a96f-41a9-9ae8-a0922e15e562 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 13:09:02.019931 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-495bc325-a96f-41a9-9ae8-a0922e15e562 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:02.021712 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-495bc325-a96f-41a9-9ae8-a0922e15e562 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:02.023581 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-495bc325-a96f-41a9-9ae8-a0922e15e562 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:02.024213 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-495bc325-a96f-41a9-9ae8-a0922e15e562 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:02.067408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-495bc325-a96f-41a9-9ae8-a0922e15e562 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Getting quotas for project 23cfcb8de5e448b8af185376a035263b. Resources: {'instances', 'ram', 'cores'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 13:09:02.074249 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-495bc325-a96f-41a9-9ae8-a0922e15e562 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Getting quotas for user 36693fa42a7b41279c8d8c59ecafb243 and project 23cfcb8de5e448b8af185376a035263b. Resources: {'instances', 'ram', 'cores'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 13:09:02.093483 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-495bc325-a96f-41a9-9ae8-a0922e15e562 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Going to run 1 instances... {{(pid=119409) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 13:09:02.096961 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-495bc325-a96f-41a9-9ae8-a0922e15e562 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0aabcc0-d4af-4f0e-b8a5-d140344fce1f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 13:09:02.259816 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-495bc325-a96f-41a9-9ae8-a0922e15e562 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.314751 Aug 03 13:09:02.262053 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 464/931] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 3 13:09:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 1318 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 13:09:02.273884 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-de547c25-46ff-46de-a060-72bd9d62c64b tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:02.281119 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-de547c25-46ff-46de-a060-72bd9d62c64b tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:02.380454 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-de547c25-46ff-46de-a060-72bd9d62c64b tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:02.397768 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-de547c25-46ff-46de-a060-72bd9d62c64b tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c" status: 200 len: 1241 microversion: 2.1 time: 0.128697 Aug 03 13:09:02.404245 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 468/932] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:02 2022] GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c => generated 1241 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:09:02.485388 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-02e5d8a7-1b8e-4bc6-8183-48e20bdff70c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:09:02.486207 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-02e5d8a7-1b8e-4bc6-8183-48e20bdff70c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:02.505237 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-02e5d8a7-1b8e-4bc6-8183-48e20bdff70c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:02.505881 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-02e5d8a7-1b8e-4bc6-8183-48e20bdff70c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:02.515458 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-02e5d8a7-1b8e-4bc6-8183-48e20bdff70c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:02.515458 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-02e5d8a7-1b8e-4bc6-8183-48e20bdff70c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:02.533610 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.objects.instance [None req-02e5d8a7-1b8e-4bc6-8183-48e20bdff70c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lazy-loading 'flavor' on Instance uuid 9f0de60a-97c6-4897-a746-1c626065c1c7 {{(pid=119409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:09:03.101860 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-02e5d8a7-1b8e-4bc6-8183-48e20bdff70c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "POST /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7/action" status: 202 len: 0 microversion: 2.20 time: 0.622157 Aug 03 13:09:03.102583 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 465/933] 10.222.0.64 () {62 vars in 1319 bytes} [Wed Aug 3 13:09:02 2022] POST /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7/action => generated 0 bytes in 624 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 13:09:03.111064 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-ca88137c-925a-4ba9-af41-02c83c89a1f4 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:03.118992 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-ca88137c-925a-4ba9-af41-02c83c89a1f4 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:03.133003 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ca88137c-925a-4ba9-af41-02c83c89a1f4 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:03.133459 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ca88137c-925a-4ba9-af41-02c83c89a1f4 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:03.134245 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ca88137c-925a-4ba9-af41-02c83c89a1f4 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:03.134695 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ca88137c-925a-4ba9-af41-02c83c89a1f4 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:03.392507 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ca88137c-925a-4ba9-af41-02c83c89a1f4 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:03.409148 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ca88137c-925a-4ba9-af41-02c83c89a1f4 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:03.413958 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ca88137c-925a-4ba9-af41-02c83c89a1f4 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:03.415371 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-ca88137c-925a-4ba9-af41-02c83c89a1f4 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1725 microversion: 2.20 time: 0.308003 Aug 03 13:09:03.416140 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 469/934] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:03 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1725 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:09:03.431074 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-280aa97f-08f1-4e36-a30c-ada3717946a1 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:03.431969 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-280aa97f-08f1-4e36-a30c-ada3717946a1 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:03.439854 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-280aa97f-08f1-4e36-a30c-ada3717946a1 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:03.440643 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-280aa97f-08f1-4e36-a30c-ada3717946a1 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:03.441736 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-280aa97f-08f1-4e36-a30c-ada3717946a1 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:03.442268 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-280aa97f-08f1-4e36-a30c-ada3717946a1 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:03.526165 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-280aa97f-08f1-4e36-a30c-ada3717946a1 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:03.534388 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-280aa97f-08f1-4e36-a30c-ada3717946a1 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c" status: 200 len: 1245 microversion: 2.1 time: 0.112480 Aug 03 13:09:03.547187 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 466/935] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:03 2022] GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c => generated 1245 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:09:03.939283 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-6bf1991a-a253-4397-8c49-608a8f01fba5 req-e93c0d92-bade-4758-b9a6-04a542df45c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeb53552-b05d-4931-920f-b11bac28243b", "tag": "1db7a902-7951-431f-9eb7-e35311be4427"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:09:03.965796 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-6bf1991a-a253-4397-8c49-608a8f01fba5 req-e93c0d92-bade-4758-b9a6-04a542df45c3 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:03.966244 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-6bf1991a-a253-4397-8c49-608a8f01fba5 req-e93c0d92-bade-4758-b9a6-04a542df45c3 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:04.007588 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-6bf1991a-a253-4397-8c49-608a8f01fba5 req-e93c0d92-bade-4758-b9a6-04a542df45c3 service nova] Creating event network-changed:1db7a902-7951-431f-9eb7-e35311be4427 for instance eeb53552-b05d-4931-920f-b11bac28243b on hv-cinder-85083 Aug 03 13:09:04.007588 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-6bf1991a-a253-4397-8c49-608a8f01fba5 req-e93c0d92-bade-4758-b9a6-04a542df45c3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071154 Aug 03 13:09:04.007588 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 470/936] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:09:04.443461 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-c09fbb1b-125b-4156-8c61-d5a27428a5d1 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:04.443986 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-c09fbb1b-125b-4156-8c61-d5a27428a5d1 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:04.463400 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c09fbb1b-125b-4156-8c61-d5a27428a5d1 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:04.464642 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c09fbb1b-125b-4156-8c61-d5a27428a5d1 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:04.465906 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c09fbb1b-125b-4156-8c61-d5a27428a5d1 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:04.466797 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c09fbb1b-125b-4156-8c61-d5a27428a5d1 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:04.591791 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-8e75aba9-c5a8-4249-b2c5-504130dcae29 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:04.592749 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-8e75aba9-c5a8-4249-b2c5-504130dcae29 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:04.616094 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8e75aba9-c5a8-4249-b2c5-504130dcae29 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:04.616551 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8e75aba9-c5a8-4249-b2c5-504130dcae29 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:04.617329 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8e75aba9-c5a8-4249-b2c5-504130dcae29 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:04.617765 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8e75aba9-c5a8-4249-b2c5-504130dcae29 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:04.639181 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-c09fbb1b-125b-4156-8c61-d5a27428a5d1 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:04.648304 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-c09fbb1b-125b-4156-8c61-d5a27428a5d1 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:04.654262 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-c09fbb1b-125b-4156-8c61-d5a27428a5d1 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:04.656940 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-c09fbb1b-125b-4156-8c61-d5a27428a5d1 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1725 microversion: 2.20 time: 0.217659 Aug 03 13:09:04.658360 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 467/937] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:04 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:09:04.717475 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-8e75aba9-c5a8-4249-b2c5-504130dcae29 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:04.741435 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-8e75aba9-c5a8-4249-b2c5-504130dcae29 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c" status: 200 len: 1293 microversion: 2.1 time: 0.173330 Aug 03 13:09:04.744736 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 471/938] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:04 2022] GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c => generated 1293 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:09:05.681697 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-dd194d37-229b-4908-b133-a8ec1a22c163 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:05.682444 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-dd194d37-229b-4908-b133-a8ec1a22c163 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:05.690980 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-dd194d37-229b-4908-b133-a8ec1a22c163 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:05.692590 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-dd194d37-229b-4908-b133-a8ec1a22c163 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:05.693575 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-dd194d37-229b-4908-b133-a8ec1a22c163 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:05.694290 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-dd194d37-229b-4908-b133-a8ec1a22c163 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:05.770980 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-c41572c2-04a9-4634-a61b-879f168fec11 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:05.772309 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-c41572c2-04a9-4634-a61b-879f168fec11 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:05.780431 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c41572c2-04a9-4634-a61b-879f168fec11 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:05.781123 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c41572c2-04a9-4634-a61b-879f168fec11 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:05.782334 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c41572c2-04a9-4634-a61b-879f168fec11 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:05.783031 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c41572c2-04a9-4634-a61b-879f168fec11 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:05.873463 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c41572c2-04a9-4634-a61b-879f168fec11 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:05.881694 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-c41572c2-04a9-4634-a61b-879f168fec11 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c" status: 200 len: 1299 microversion: 2.1 time: 0.114650 Aug 03 13:09:05.883056 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 472/939] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:05 2022] GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c => generated 1299 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:09:05.912949 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-dd194d37-229b-4908-b133-a8ec1a22c163 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:05.923004 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-dd194d37-229b-4908-b133-a8ec1a22c163 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:05.925475 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-dd194d37-229b-4908-b133-a8ec1a22c163 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:05.928146 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-dd194d37-229b-4908-b133-a8ec1a22c163 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1725 microversion: 2.20 time: 0.250977 Aug 03 13:09:05.931525 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 468/940] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:05 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1725 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:09:06.908596 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d3bdae29-653a-462b-95f8-e8a5673cd973 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:06.918116 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d3bdae29-653a-462b-95f8-e8a5673cd973 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:06.921397 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d3bdae29-653a-462b-95f8-e8a5673cd973 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:06.923007 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d3bdae29-653a-462b-95f8-e8a5673cd973 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:06.923810 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d3bdae29-653a-462b-95f8-e8a5673cd973 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:06.925912 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d3bdae29-653a-462b-95f8-e8a5673cd973 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:06.963790 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-db135322-17e2-4b25-9faf-3343b7fc33e7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:06.963790 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-db135322-17e2-4b25-9faf-3343b7fc33e7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:06.988777 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-db135322-17e2-4b25-9faf-3343b7fc33e7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:06.989704 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-db135322-17e2-4b25-9faf-3343b7fc33e7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:06.990952 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-db135322-17e2-4b25-9faf-3343b7fc33e7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:06.992893 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-db135322-17e2-4b25-9faf-3343b7fc33e7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:07.184687 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d3bdae29-653a-462b-95f8-e8a5673cd973 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:07.197537 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d3bdae29-653a-462b-95f8-e8a5673cd973 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c" status: 200 len: 1367 microversion: 2.1 time: 0.291996 Aug 03 13:09:07.218681 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-db135322-17e2-4b25-9faf-3343b7fc33e7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:07.228876 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 473/941] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:06 2022] GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c => generated 1367 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:09:07.234199 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-db135322-17e2-4b25-9faf-3343b7fc33e7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:07.239120 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-db135322-17e2-4b25-9faf-3343b7fc33e7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:07.242801 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-db135322-17e2-4b25-9faf-3343b7fc33e7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1725 microversion: 2.20 time: 0.290458 Aug 03 13:09:07.247021 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 469/942] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:06 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1725 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:09:07.265769 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-3882bf52-731e-4a75-8c82-3c0d6ab491ba req-445a63d8-efb0-407c-848b-231849d76aad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0acaf59b-bda1-4a84-aa4b-620a1a173e3c", "tag": "74f6fb9f-3ac0-433e-8782-91aed42cb91e"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:09:07.275602 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-3882bf52-731e-4a75-8c82-3c0d6ab491ba req-445a63d8-efb0-407c-848b-231849d76aad service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:07.276026 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-3882bf52-731e-4a75-8c82-3c0d6ab491ba req-445a63d8-efb0-407c-848b-231849d76aad service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:07.287637 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-3882bf52-731e-4a75-8c82-3c0d6ab491ba req-445a63d8-efb0-407c-848b-231849d76aad service nova] Creating event network-changed:74f6fb9f-3ac0-433e-8782-91aed42cb91e for instance 0acaf59b-bda1-4a84-aa4b-620a1a173e3c on hv-cinder-85083 Aug 03 13:09:07.292663 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-3882bf52-731e-4a75-8c82-3c0d6ab491ba req-445a63d8-efb0-407c-848b-231849d76aad service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031390 Aug 03 13:09:07.293433 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 474/943] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:09:08.224358 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-90720201-5527-4ec4-a98b-a77c96b61ada tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:08.224973 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-90720201-5527-4ec4-a98b-a77c96b61ada tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:08.233943 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-90720201-5527-4ec4-a98b-a77c96b61ada tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:08.234768 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-90720201-5527-4ec4-a98b-a77c96b61ada tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:08.235612 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-90720201-5527-4ec4-a98b-a77c96b61ada tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:08.236480 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-90720201-5527-4ec4-a98b-a77c96b61ada tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:08.272899 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-91844313-9ab1-45f1-8491-2d964dc4fe43 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:08.273744 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-91844313-9ab1-45f1-8491-2d964dc4fe43 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:08.281722 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-91844313-9ab1-45f1-8491-2d964dc4fe43 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:08.282625 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-91844313-9ab1-45f1-8491-2d964dc4fe43 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:08.291244 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-91844313-9ab1-45f1-8491-2d964dc4fe43 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:08.291244 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-91844313-9ab1-45f1-8491-2d964dc4fe43 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:08.563470 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-90720201-5527-4ec4-a98b-a77c96b61ada tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:08.569639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:09:08.569856 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-91844313-9ab1-45f1-8491-2d964dc4fe43 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:08.571470 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-90720201-5527-4ec4-a98b-a77c96b61ada tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c" status: 200 len: 1367 microversion: 2.1 time: 0.355380 Aug 03 13:09:08.574325 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 470/944] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:08 2022] GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c => generated 1367 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:09:08.574452 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=100 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:09:08.579295 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-91844313-9ab1-45f1-8491-2d964dc4fe43 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:08.584689 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-91844313-9ab1-45f1-8491-2d964dc4fe43 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:08.586072 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-91844313-9ab1-45f1-8491-2d964dc4fe43 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1725 microversion: 2.20 time: 0.318399 Aug 03 13:09:08.586661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 475/945] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:08 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1725 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:09:09.594122 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ccc64b83-0126-4c40-a6b4-c18c82293024 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:09.595310 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-ccc64b83-0126-4c40-a6b4-c18c82293024 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:09.602558 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ccc64b83-0126-4c40-a6b4-c18c82293024 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:09.603387 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ccc64b83-0126-4c40-a6b4-c18c82293024 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:09.604272 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ccc64b83-0126-4c40-a6b4-c18c82293024 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:09.605484 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ccc64b83-0126-4c40-a6b4-c18c82293024 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:09.611363 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1f622a86-a6a6-4395-85cf-59875e76c395 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:09.612572 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-1f622a86-a6a6-4395-85cf-59875e76c395 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:09.621552 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1f622a86-a6a6-4395-85cf-59875e76c395 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:09.622952 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1f622a86-a6a6-4395-85cf-59875e76c395 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:09.624171 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1f622a86-a6a6-4395-85cf-59875e76c395 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:09.624981 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1f622a86-a6a6-4395-85cf-59875e76c395 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:09.931416 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ccc64b83-0126-4c40-a6b4-c18c82293024 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:09.935919 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-1f622a86-a6a6-4395-85cf-59875e76c395 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:09.940229 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-ccc64b83-0126-4c40-a6b4-c18c82293024 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c" status: 200 len: 1367 microversion: 2.1 time: 0.351254 Aug 03 13:09:09.941486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 471/946] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:09 2022] GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:09:09.951983 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-1f622a86-a6a6-4395-85cf-59875e76c395 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:09.954626 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-1f622a86-a6a6-4395-85cf-59875e76c395 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:09.955867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-1f622a86-a6a6-4395-85cf-59875e76c395 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1725 microversion: 2.20 time: 0.348476 Aug 03 13:09:09.956627 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 476/947] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:09 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1725 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:09:10.961486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ba49eb85-a074-47e5-a626-13786d2c9a57 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:10.962180 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-ba49eb85-a074-47e5-a626-13786d2c9a57 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:10.969549 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ba49eb85-a074-47e5-a626-13786d2c9a57 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:10.970009 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ba49eb85-a074-47e5-a626-13786d2c9a57 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:10.970848 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ba49eb85-a074-47e5-a626-13786d2c9a57 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:10.971286 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ba49eb85-a074-47e5-a626-13786d2c9a57 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:10.980820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-025b6774-fe36-4c95-bfa5-59702af046a6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:10.981430 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-025b6774-fe36-4c95-bfa5-59702af046a6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:11.004687 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-025b6774-fe36-4c95-bfa5-59702af046a6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:11.014494 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-025b6774-fe36-4c95-bfa5-59702af046a6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:11.015708 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-025b6774-fe36-4c95-bfa5-59702af046a6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:11.016160 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-025b6774-fe36-4c95-bfa5-59702af046a6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:11.247686 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ba49eb85-a074-47e5-a626-13786d2c9a57 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:11.256412 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-ba49eb85-a074-47e5-a626-13786d2c9a57 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c" status: 200 len: 1367 microversion: 2.1 time: 0.298738 Aug 03 13:09:11.257397 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 472/948] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:10 2022] GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c => generated 1367 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:09:11.273103 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-025b6774-fe36-4c95-bfa5-59702af046a6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:11.282756 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-025b6774-fe36-4c95-bfa5-59702af046a6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:11.285270 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-025b6774-fe36-4c95-bfa5-59702af046a6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:11.286806 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-025b6774-fe36-4c95-bfa5-59702af046a6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1725 microversion: 2.20 time: 0.309902 Aug 03 13:09:11.295120 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 477/949] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:10 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1725 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:09:12.070227 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell0:SELECT=2 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:09:12.091983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell0:SELECT=10 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:09:12.272171 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-470e58b1-bff9-466f-9af5-45c3a926d2da tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Action: 'create', calling method: .version_select at 0x7fe6d815c0d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1280873694", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfRddtUK/HNE3sbMXm5mpZO3Ftq23GzMqcEHxk1U9AQCZFxbwt/8WU0uK73CCElo/8dStcGYXsaKsiD7XWta2UMOS+T+4F2Q53jRW5vHvz7OUBxfzuknY5khc3nUhogtQ=="}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:09:12.277775 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-5c7c409c-6d92-45e4-a0fc-88e492bfb589 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:12.278285 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-5c7c409c-6d92-45e4-a0fc-88e492bfb589 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:12.284583 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5c7c409c-6d92-45e4-a0fc-88e492bfb589 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:12.285223 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5c7c409c-6d92-45e4-a0fc-88e492bfb589 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:12.285988 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5c7c409c-6d92-45e4-a0fc-88e492bfb589 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:12.286429 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5c7c409c-6d92-45e4-a0fc-88e492bfb589 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:12.289383 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-470e58b1-bff9-466f-9af5-45c3a926d2da tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Getting quotas for project 8d0b838da49141f99cb5073f13024892. Resources: {'key_pairs'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 13:09:12.294224 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-470e58b1-bff9-466f-9af5-45c3a926d2da tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Getting quotas for user 5094778e88de495d96981c16da9ee916 and project 8d0b838da49141f99cb5073f13024892. Resources: {'key_pairs'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 13:09:12.394694 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-470e58b1-bff9-466f-9af5-45c3a926d2da tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.329282 Aug 03 13:09:12.395378 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 473/950] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Aug 3 13:09:12 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:09:12.396851 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=2 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:09:12.407488 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-9eb603a5-b29e-476e-bce1-729d2bcb5cb7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:12.408101 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-9eb603a5-b29e-476e-bce1-729d2bcb5cb7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:12.416668 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9eb603a5-b29e-476e-bce1-729d2bcb5cb7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:12.417899 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9eb603a5-b29e-476e-bce1-729d2bcb5cb7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:12.418673 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9eb603a5-b29e-476e-bce1-729d2bcb5cb7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:12.419319 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9eb603a5-b29e-476e-bce1-729d2bcb5cb7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:12.426634 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-5c7c409c-6d92-45e4-a0fc-88e492bfb589 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:12.435822 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-5c7c409c-6d92-45e4-a0fc-88e492bfb589 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c" status: 200 len: 1367 microversion: 2.1 time: 0.162247 Aug 03 13:09:12.436814 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 478/951] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:12 2022] GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:09:12.553644 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-9eb603a5-b29e-476e-bce1-729d2bcb5cb7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:12.563018 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-9eb603a5-b29e-476e-bce1-729d2bcb5cb7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:12.564938 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-9eb603a5-b29e-476e-bce1-729d2bcb5cb7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:12.567093 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-9eb603a5-b29e-476e-bce1-729d2bcb5cb7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1725 microversion: 2.20 time: 0.165087 Aug 03 13:09:12.574895 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 474/952] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:12 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:09:13.456894 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-c7c3634d-5b8e-451a-8977-a97702347986 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:13.457513 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-c7c3634d-5b8e-451a-8977-a97702347986 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:13.464163 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c7c3634d-5b8e-451a-8977-a97702347986 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:13.464621 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c7c3634d-5b8e-451a-8977-a97702347986 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:13.465393 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c7c3634d-5b8e-451a-8977-a97702347986 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:13.465828 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c7c3634d-5b8e-451a-8977-a97702347986 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:13.593952 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-e3255743-2716-45de-80c4-5f77d8d2acfc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:13.596110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-e3255743-2716-45de-80c4-5f77d8d2acfc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:13.610508 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e3255743-2716-45de-80c4-5f77d8d2acfc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:13.611002 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e3255743-2716-45de-80c4-5f77d8d2acfc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:13.615717 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e3255743-2716-45de-80c4-5f77d8d2acfc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:13.615717 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e3255743-2716-45de-80c4-5f77d8d2acfc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:13.616061 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c7c3634d-5b8e-451a-8977-a97702347986 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:13.624998 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-c7c3634d-5b8e-451a-8977-a97702347986 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c" status: 200 len: 1367 microversion: 2.1 time: 0.172130 Aug 03 13:09:13.626259 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 479/953] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:13 2022] GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:09:13.749761 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-e3255743-2716-45de-80c4-5f77d8d2acfc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:13.757799 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-e3255743-2716-45de-80c4-5f77d8d2acfc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:13.759327 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-e3255743-2716-45de-80c4-5f77d8d2acfc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:13.760483 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-e3255743-2716-45de-80c4-5f77d8d2acfc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1725 microversion: 2.20 time: 0.173087 Aug 03 13:09:13.761068 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 475/954] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:13 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:09:14.646637 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-5538dd5d-36fc-415b-9f63-7bd2e7afbcd2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:14.647385 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-5538dd5d-36fc-415b-9f63-7bd2e7afbcd2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:14.655090 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5538dd5d-36fc-415b-9f63-7bd2e7afbcd2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:14.655597 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5538dd5d-36fc-415b-9f63-7bd2e7afbcd2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:14.656339 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5538dd5d-36fc-415b-9f63-7bd2e7afbcd2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:14.656864 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5538dd5d-36fc-415b-9f63-7bd2e7afbcd2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:14.782686 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-88feae62-8b3d-45b8-9c9a-333f6244f521 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:14.783471 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-88feae62-8b3d-45b8-9c9a-333f6244f521 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:14.793708 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-88feae62-8b3d-45b8-9c9a-333f6244f521 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:14.794411 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-88feae62-8b3d-45b8-9c9a-333f6244f521 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:14.795365 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-88feae62-8b3d-45b8-9c9a-333f6244f521 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:14.795957 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-88feae62-8b3d-45b8-9c9a-333f6244f521 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:14.820881 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-5538dd5d-36fc-415b-9f63-7bd2e7afbcd2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:14.830523 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-5538dd5d-36fc-415b-9f63-7bd2e7afbcd2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c" status: 200 len: 1367 microversion: 2.1 time: 0.187685 Aug 03 13:09:14.831596 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 480/955] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:14 2022] GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:09:14.932005 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-88feae62-8b3d-45b8-9c9a-333f6244f521 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:14.942103 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-88feae62-8b3d-45b8-9c9a-333f6244f521 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:14.943931 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-88feae62-8b3d-45b8-9c9a-333f6244f521 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:14.945491 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-88feae62-8b3d-45b8-9c9a-333f6244f521 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1746 microversion: 2.20 time: 0.166643 Aug 03 13:09:14.946581 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 476/956] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:14 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1746 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:09:15.208141 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-8e815296-53e1-4dec-ae1a-d82bead2b9c8 req-7f7bbdf8-2ead-4f86-b1da-7dbc8424dc95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0acaf59b-bda1-4a84-aa4b-620a1a173e3c", "name": "network-vif-plugged", "status": "completed", "tag": "74f6fb9f-3ac0-433e-8782-91aed42cb91e"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:09:15.218653 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-8e815296-53e1-4dec-ae1a-d82bead2b9c8 req-7f7bbdf8-2ead-4f86-b1da-7dbc8424dc95 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:15.219153 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-8e815296-53e1-4dec-ae1a-d82bead2b9c8 req-7f7bbdf8-2ead-4f86-b1da-7dbc8424dc95 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:15.230637 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-8e815296-53e1-4dec-ae1a-d82bead2b9c8 req-7f7bbdf8-2ead-4f86-b1da-7dbc8424dc95 service nova] Creating event network-vif-plugged:74f6fb9f-3ac0-433e-8782-91aed42cb91e for instance 0acaf59b-bda1-4a84-aa4b-620a1a173e3c on hv-cinder-85083 Aug 03 13:09:15.235505 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-8e815296-53e1-4dec-ae1a-d82bead2b9c8 req-7f7bbdf8-2ead-4f86-b1da-7dbc8424dc95 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031675 Aug 03 13:09:15.236093 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 481/957] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:09:15.851604 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-7726ca41-49f0-4e68-a463-02f3874e8a8f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:15.852218 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-7726ca41-49f0-4e68-a463-02f3874e8a8f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:15.859584 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7726ca41-49f0-4e68-a463-02f3874e8a8f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:15.860031 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7726ca41-49f0-4e68-a463-02f3874e8a8f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:15.860792 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7726ca41-49f0-4e68-a463-02f3874e8a8f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:15.861294 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7726ca41-49f0-4e68-a463-02f3874e8a8f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:15.972777 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-41c64c3a-2c00-4645-bf90-30eab0ece069 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:15.974350 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-41c64c3a-2c00-4645-bf90-30eab0ece069 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:15.981023 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-41c64c3a-2c00-4645-bf90-30eab0ece069 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:15.981677 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-41c64c3a-2c00-4645-bf90-30eab0ece069 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:15.982635 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-41c64c3a-2c00-4645-bf90-30eab0ece069 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:15.983298 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-41c64c3a-2c00-4645-bf90-30eab0ece069 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:16.007153 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-7726ca41-49f0-4e68-a463-02f3874e8a8f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:16.012969 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-7726ca41-49f0-4e68-a463-02f3874e8a8f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c" status: 200 len: 1367 microversion: 2.1 time: 0.164229 Aug 03 13:09:16.013822 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 477/958] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:15 2022] GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:09:16.126694 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-41c64c3a-2c00-4645-bf90-30eab0ece069 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:16.135065 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-41c64c3a-2c00-4645-bf90-30eab0ece069 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:16.137245 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-41c64c3a-2c00-4645-bf90-30eab0ece069 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:16.138478 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-41c64c3a-2c00-4645-bf90-30eab0ece069 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1746 microversion: 2.20 time: 0.170520 Aug 03 13:09:16.139148 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 482/959] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:15 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1746 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:09:17.038055 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-84aff4b2-02d5-4c0b-a442-ede59e864ae8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:17.038721 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-84aff4b2-02d5-4c0b-a442-ede59e864ae8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:17.045825 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-84aff4b2-02d5-4c0b-a442-ede59e864ae8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:17.046270 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-84aff4b2-02d5-4c0b-a442-ede59e864ae8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:17.047062 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-84aff4b2-02d5-4c0b-a442-ede59e864ae8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:17.047486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-84aff4b2-02d5-4c0b-a442-ede59e864ae8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:17.162063 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-cc4b15ad-8f26-4a0a-81bd-9db020f1054f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:17.162753 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-cc4b15ad-8f26-4a0a-81bd-9db020f1054f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:17.170118 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cc4b15ad-8f26-4a0a-81bd-9db020f1054f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:17.170839 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cc4b15ad-8f26-4a0a-81bd-9db020f1054f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:17.171880 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cc4b15ad-8f26-4a0a-81bd-9db020f1054f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:17.172492 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cc4b15ad-8f26-4a0a-81bd-9db020f1054f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:17.200393 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-84aff4b2-02d5-4c0b-a442-ede59e864ae8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:17.209109 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-84aff4b2-02d5-4c0b-a442-ede59e864ae8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c" status: 200 len: 1367 microversion: 2.1 time: 0.175286 Aug 03 13:09:17.209742 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 478/960] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:17 2022] GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:09:17.315479 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-cc4b15ad-8f26-4a0a-81bd-9db020f1054f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:17.324400 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-cc4b15ad-8f26-4a0a-81bd-9db020f1054f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:17.326245 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-cc4b15ad-8f26-4a0a-81bd-9db020f1054f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:17.327457 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-cc4b15ad-8f26-4a0a-81bd-9db020f1054f tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1746 microversion: 2.20 time: 0.169755 Aug 03 13:09:17.328112 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 483/961] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:17 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1746 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:09:18.229589 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-6a2c4e67-1d87-46a2-b0b0-0a069ea78d20 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:18.230307 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-6a2c4e67-1d87-46a2-b0b0-0a069ea78d20 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:18.237233 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6a2c4e67-1d87-46a2-b0b0-0a069ea78d20 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:18.237679 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6a2c4e67-1d87-46a2-b0b0-0a069ea78d20 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:18.238438 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6a2c4e67-1d87-46a2-b0b0-0a069ea78d20 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:18.238944 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6a2c4e67-1d87-46a2-b0b0-0a069ea78d20 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:18.349548 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-84ab51af-23be-4be7-bd97-e7fe9ed5ef35 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:18.350147 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-84ab51af-23be-4be7-bd97-e7fe9ed5ef35 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:18.357510 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-84ab51af-23be-4be7-bd97-e7fe9ed5ef35 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:18.357973 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-84ab51af-23be-4be7-bd97-e7fe9ed5ef35 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:18.359377 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-84ab51af-23be-4be7-bd97-e7fe9ed5ef35 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:18.360155 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-84ab51af-23be-4be7-bd97-e7fe9ed5ef35 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:18.373061 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-6a2c4e67-1d87-46a2-b0b0-0a069ea78d20 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:18.380521 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-6a2c4e67-1d87-46a2-b0b0-0a069ea78d20 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c" status: 200 len: 1557 microversion: 2.1 time: 0.154964 Aug 03 13:09:18.381122 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 479/962] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:18 2022] GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:09:18.401183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-7ed383e3-de53-4ec4-8797-fde06120d49f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:18.401680 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-7ed383e3-de53-4ec4-8797-fde06120d49f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:18.407931 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7ed383e3-de53-4ec4-8797-fde06120d49f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:18.408380 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7ed383e3-de53-4ec4-8797-fde06120d49f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:18.409150 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7ed383e3-de53-4ec4-8797-fde06120d49f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:18.409584 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7ed383e3-de53-4ec4-8797-fde06120d49f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:18.510249 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-7ed383e3-de53-4ec4-8797-fde06120d49f tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112785 Aug 03 13:09:18.511030 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 480/963] 10.222.0.64 () {58 vars in 1275 bytes} [Wed Aug 3 13:09:18 2022] GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:09:18.532836 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-84ab51af-23be-4be7-bd97-e7fe9ed5ef35 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:18.541112 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-84ab51af-23be-4be7-bd97-e7fe9ed5ef35 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:18.543425 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-84ab51af-23be-4be7-bd97-e7fe9ed5ef35 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:18.544726 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-84ab51af-23be-4be7-bd97-e7fe9ed5ef35 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1746 microversion: 2.20 time: 0.199204 Aug 03 13:09:18.545471 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 484/964] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:18 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1746 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:09:19.088180 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-6e29bd33-cd94-4754-9a29-54a4b6996fe7 req-7177e3c9-2a6a-401c-92d4-f7093d45c030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f0de60a-97c6-4897-a746-1c626065c1c7", "name": "network-vif-plugged", "status": "completed", "tag": "9a26950b-91c5-47f5-a903-f189d725973f"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:09:19.102348 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-6e29bd33-cd94-4754-9a29-54a4b6996fe7 req-7177e3c9-2a6a-401c-92d4-f7093d45c030 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:19.102862 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-6e29bd33-cd94-4754-9a29-54a4b6996fe7 req-7177e3c9-2a6a-401c-92d4-f7093d45c030 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:19.116565 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-6e29bd33-cd94-4754-9a29-54a4b6996fe7 req-7177e3c9-2a6a-401c-92d4-f7093d45c030 service nova] Creating event network-vif-plugged:9a26950b-91c5-47f5-a903-f189d725973f for instance 9f0de60a-97c6-4897-a746-1c626065c1c7 on hv-cinder-85083 Aug 03 13:09:19.121855 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-6e29bd33-cd94-4754-9a29-54a4b6996fe7 req-7177e3c9-2a6a-401c-92d4-f7093d45c030 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037814 Aug 03 13:09:19.122501 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 481/965] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:09:19.564620 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-87f280ba-ae11-4dfb-8f20-6e0ead24a3df req-4b93d796-f855-4772-8f84-b9b5a63b08db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0acaf59b-bda1-4a84-aa4b-620a1a173e3c", "tag": "74f6fb9f-3ac0-433e-8782-91aed42cb91e"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:09:19.568764 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-0a345e24-5095-4dcf-bb6b-f941b3a9cd3c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:19.569448 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-0a345e24-5095-4dcf-bb6b-f941b3a9cd3c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:19.575148 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-87f280ba-ae11-4dfb-8f20-6e0ead24a3df req-4b93d796-f855-4772-8f84-b9b5a63b08db service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:19.575726 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-87f280ba-ae11-4dfb-8f20-6e0ead24a3df req-4b93d796-f855-4772-8f84-b9b5a63b08db service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:19.578316 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0a345e24-5095-4dcf-bb6b-f941b3a9cd3c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:19.578775 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0a345e24-5095-4dcf-bb6b-f941b3a9cd3c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:19.581347 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0a345e24-5095-4dcf-bb6b-f941b3a9cd3c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:19.581347 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0a345e24-5095-4dcf-bb6b-f941b3a9cd3c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:19.589206 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-87f280ba-ae11-4dfb-8f20-6e0ead24a3df req-4b93d796-f855-4772-8f84-b9b5a63b08db service nova] Creating event network-changed:74f6fb9f-3ac0-433e-8782-91aed42cb91e for instance 0acaf59b-bda1-4a84-aa4b-620a1a173e3c on hv-cinder-85083 Aug 03 13:09:19.594462 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-87f280ba-ae11-4dfb-8f20-6e0ead24a3df req-4b93d796-f855-4772-8f84-b9b5a63b08db service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034004 Aug 03 13:09:19.595187 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 485/966] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:09:19.729304 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-0a345e24-5095-4dcf-bb6b-f941b3a9cd3c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:19.737486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-0a345e24-5095-4dcf-bb6b-f941b3a9cd3c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:19.739367 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-0a345e24-5095-4dcf-bb6b-f941b3a9cd3c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:19.740563 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-0a345e24-5095-4dcf-bb6b-f941b3a9cd3c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1746 microversion: 2.20 time: 0.176996 Aug 03 13:09:19.741121 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 482/967] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:19 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1746 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:09:20.765187 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-68721eb7-4eb3-4c57-904b-22f6eb408442 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:20.765891 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-68721eb7-4eb3-4c57-904b-22f6eb408442 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:20.775550 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-68721eb7-4eb3-4c57-904b-22f6eb408442 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:20.776529 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-68721eb7-4eb3-4c57-904b-22f6eb408442 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:20.777316 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-68721eb7-4eb3-4c57-904b-22f6eb408442 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:20.777756 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-68721eb7-4eb3-4c57-904b-22f6eb408442 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:20.981572 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-68721eb7-4eb3-4c57-904b-22f6eb408442 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:20.992056 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-68721eb7-4eb3-4c57-904b-22f6eb408442 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:20.993608 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-68721eb7-4eb3-4c57-904b-22f6eb408442 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:20.995571 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-68721eb7-4eb3-4c57-904b-22f6eb408442 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1741 microversion: 2.20 time: 0.235508 Aug 03 13:09:20.998588 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 486/968] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:20 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1741 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:09:22.021292 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-492d517a-7241-471d-80cf-50700b281bb0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:22.022476 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-492d517a-7241-471d-80cf-50700b281bb0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:22.031980 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-492d517a-7241-471d-80cf-50700b281bb0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:22.032460 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-492d517a-7241-471d-80cf-50700b281bb0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:22.033494 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-492d517a-7241-471d-80cf-50700b281bb0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:22.033918 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-492d517a-7241-471d-80cf-50700b281bb0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:22.191173 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-492d517a-7241-471d-80cf-50700b281bb0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:22.201759 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-492d517a-7241-471d-80cf-50700b281bb0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:22.204380 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-492d517a-7241-471d-80cf-50700b281bb0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:22.205562 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-492d517a-7241-471d-80cf-50700b281bb0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1741 microversion: 2.20 time: 0.188086 Aug 03 13:09:22.206118 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 483/969] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:22 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1741 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:09:23.229582 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-5811b1cd-fe54-40ff-af31-27fbcf054ce3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:23.230194 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-5811b1cd-fe54-40ff-af31-27fbcf054ce3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:23.239299 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5811b1cd-fe54-40ff-af31-27fbcf054ce3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:23.239745 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5811b1cd-fe54-40ff-af31-27fbcf054ce3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:23.240758 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5811b1cd-fe54-40ff-af31-27fbcf054ce3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:23.241202 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5811b1cd-fe54-40ff-af31-27fbcf054ce3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:23.389808 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-5811b1cd-fe54-40ff-af31-27fbcf054ce3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:23.400842 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-5811b1cd-fe54-40ff-af31-27fbcf054ce3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:23.402454 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-5811b1cd-fe54-40ff-af31-27fbcf054ce3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:23.403698 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-5811b1cd-fe54-40ff-af31-27fbcf054ce3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1741 microversion: 2.20 time: 0.178076 Aug 03 13:09:23.404280 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 487/970] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:23 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:09:24.428603 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-5ca21707-1e51-4b3a-84b5-9268348d2af3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:24.429825 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-5ca21707-1e51-4b3a-84b5-9268348d2af3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:24.433748 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell0:SELECT=4 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:09:24.439314 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5ca21707-1e51-4b3a-84b5-9268348d2af3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:24.439940 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5ca21707-1e51-4b3a-84b5-9268348d2af3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:24.444945 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5ca21707-1e51-4b3a-84b5-9268348d2af3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:24.445699 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5ca21707-1e51-4b3a-84b5-9268348d2af3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:24.737530 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-5ca21707-1e51-4b3a-84b5-9268348d2af3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:24.745434 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-5ca21707-1e51-4b3a-84b5-9268348d2af3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:24.746942 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-5ca21707-1e51-4b3a-84b5-9268348d2af3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:24.748081 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-5ca21707-1e51-4b3a-84b5-9268348d2af3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1741 microversion: 2.20 time: 0.323390 Aug 03 13:09:24.748640 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 484/971] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:24 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1741 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:09:25.778549 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-8576508b-5987-466d-972a-709c1dbe13a0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:25.779483 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-8576508b-5987-466d-972a-709c1dbe13a0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:25.787599 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8576508b-5987-466d-972a-709c1dbe13a0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:25.788253 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8576508b-5987-466d-972a-709c1dbe13a0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:25.789547 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8576508b-5987-466d-972a-709c1dbe13a0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:25.790506 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8576508b-5987-466d-972a-709c1dbe13a0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:25.990566 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-8576508b-5987-466d-972a-709c1dbe13a0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:25.999022 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-8576508b-5987-466d-972a-709c1dbe13a0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:26.000560 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-8576508b-5987-466d-972a-709c1dbe13a0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:26.002096 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-8576508b-5987-466d-972a-709c1dbe13a0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1741 microversion: 2.20 time: 0.232911 Aug 03 13:09:26.002870 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 488/972] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:25 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1741 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:09:27.025591 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-5e7f92aa-a84b-46e5-b31d-04bdb19df038 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:27.026178 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-5e7f92aa-a84b-46e5-b31d-04bdb19df038 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:27.033155 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5e7f92aa-a84b-46e5-b31d-04bdb19df038 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:27.033598 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5e7f92aa-a84b-46e5-b31d-04bdb19df038 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:27.034366 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5e7f92aa-a84b-46e5-b31d-04bdb19df038 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:27.034820 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-5e7f92aa-a84b-46e5-b31d-04bdb19df038 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:27.177182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-5e7f92aa-a84b-46e5-b31d-04bdb19df038 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:27.186459 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-5e7f92aa-a84b-46e5-b31d-04bdb19df038 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:27.188046 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-5e7f92aa-a84b-46e5-b31d-04bdb19df038 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:27.189222 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-5e7f92aa-a84b-46e5-b31d-04bdb19df038 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1741 microversion: 2.20 time: 0.167544 Aug 03 13:09:27.189790 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 485/973] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:27 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1741 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:09:28.213277 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-47cf6ce7-f5f8-4d48-82a6-46ae7bb57a81 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:28.213954 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-47cf6ce7-f5f8-4d48-82a6-46ae7bb57a81 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:28.221214 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-47cf6ce7-f5f8-4d48-82a6-46ae7bb57a81 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:28.221665 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-47cf6ce7-f5f8-4d48-82a6-46ae7bb57a81 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:28.222421 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-47cf6ce7-f5f8-4d48-82a6-46ae7bb57a81 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:28.222901 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-47cf6ce7-f5f8-4d48-82a6-46ae7bb57a81 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:28.375299 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-47cf6ce7-f5f8-4d48-82a6-46ae7bb57a81 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:28.383838 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-47cf6ce7-f5f8-4d48-82a6-46ae7bb57a81 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:28.385356 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-47cf6ce7-f5f8-4d48-82a6-46ae7bb57a81 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:28.386589 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-47cf6ce7-f5f8-4d48-82a6-46ae7bb57a81 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1741 microversion: 2.20 time: 0.177775 Aug 03 13:09:28.387289 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 489/974] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:28 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:09:29.409734 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-a4301a4c-9c4d-4521-8725-3cd491ac20dd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:29.410627 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-a4301a4c-9c4d-4521-8725-3cd491ac20dd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:29.413273 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:09:29.421533 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a4301a4c-9c4d-4521-8725-3cd491ac20dd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:29.423687 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a4301a4c-9c4d-4521-8725-3cd491ac20dd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:29.424077 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a4301a4c-9c4d-4521-8725-3cd491ac20dd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:29.424506 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a4301a4c-9c4d-4521-8725-3cd491ac20dd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:29.560631 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-a4301a4c-9c4d-4521-8725-3cd491ac20dd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:29.568563 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-a4301a4c-9c4d-4521-8725-3cd491ac20dd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:29.570185 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-a4301a4c-9c4d-4521-8725-3cd491ac20dd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:29.571370 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-a4301a4c-9c4d-4521-8725-3cd491ac20dd tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1741 microversion: 2.20 time: 0.165555 Aug 03 13:09:29.572090 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 486/975] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:29 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:09:30.594258 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-09299799-7e21-4278-9617-2a4b5de30b20 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:30.594888 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-09299799-7e21-4278-9617-2a4b5de30b20 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:30.601685 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-09299799-7e21-4278-9617-2a4b5de30b20 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:30.602424 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-09299799-7e21-4278-9617-2a4b5de30b20 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:30.603247 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-09299799-7e21-4278-9617-2a4b5de30b20 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:30.603679 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-09299799-7e21-4278-9617-2a4b5de30b20 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:30.738879 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-09299799-7e21-4278-9617-2a4b5de30b20 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:30.747997 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-09299799-7e21-4278-9617-2a4b5de30b20 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:30.749621 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-09299799-7e21-4278-9617-2a4b5de30b20 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:30.750891 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-09299799-7e21-4278-9617-2a4b5de30b20 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1741 microversion: 2.20 time: 0.160864 Aug 03 13:09:30.751451 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 490/976] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:30 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1741 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:09:31.775375 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-dd141a9b-1ccf-4679-9ec5-cc065992dc81 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:31.775947 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-dd141a9b-1ccf-4679-9ec5-cc065992dc81 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:31.784072 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-dd141a9b-1ccf-4679-9ec5-cc065992dc81 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:31.784601 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-dd141a9b-1ccf-4679-9ec5-cc065992dc81 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:31.785659 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-dd141a9b-1ccf-4679-9ec5-cc065992dc81 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:31.786087 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-dd141a9b-1ccf-4679-9ec5-cc065992dc81 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:31.920464 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-dd141a9b-1ccf-4679-9ec5-cc065992dc81 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:31.928282 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-dd141a9b-1ccf-4679-9ec5-cc065992dc81 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:31.929768 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-dd141a9b-1ccf-4679-9ec5-cc065992dc81 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:31.931728 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-dd141a9b-1ccf-4679-9ec5-cc065992dc81 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1741 microversion: 2.20 time: 0.159624 Aug 03 13:09:31.931728 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 487/977] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:31 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1741 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:09:32.955034 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-5111eec9-b1b5-42bd-ba10-13c428749855 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:32.956213 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-5111eec9-b1b5-42bd-ba10-13c428749855 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:32.958695 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=52 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:09:32.963643 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5111eec9-b1b5-42bd-ba10-13c428749855 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:32.964619 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5111eec9-b1b5-42bd-ba10-13c428749855 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:32.965414 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5111eec9-b1b5-42bd-ba10-13c428749855 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:32.965853 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5111eec9-b1b5-42bd-ba10-13c428749855 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:33.106701 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-5111eec9-b1b5-42bd-ba10-13c428749855 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:33.114773 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-5111eec9-b1b5-42bd-ba10-13c428749855 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:33.116345 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-5111eec9-b1b5-42bd-ba10-13c428749855 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:33.117711 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-5111eec9-b1b5-42bd-ba10-13c428749855 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1741 microversion: 2.20 time: 0.166755 Aug 03 13:09:33.118270 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 491/978] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:32 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1741 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:09:34.140689 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-0a97d789-0e1c-40f8-b01e-66b7e30d02f7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:34.141292 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-0a97d789-0e1c-40f8-b01e-66b7e30d02f7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:34.147847 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0a97d789-0e1c-40f8-b01e-66b7e30d02f7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:34.148293 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0a97d789-0e1c-40f8-b01e-66b7e30d02f7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:34.149051 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0a97d789-0e1c-40f8-b01e-66b7e30d02f7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:34.149478 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0a97d789-0e1c-40f8-b01e-66b7e30d02f7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:34.282442 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-0a97d789-0e1c-40f8-b01e-66b7e30d02f7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:34.290523 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-0a97d789-0e1c-40f8-b01e-66b7e30d02f7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:34.292872 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-0a97d789-0e1c-40f8-b01e-66b7e30d02f7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:34.294011 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-0a97d789-0e1c-40f8-b01e-66b7e30d02f7 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1741 microversion: 2.20 time: 0.157232 Aug 03 13:09:34.294567 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 488/979] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:34 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1741 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:09:35.316939 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-727048f1-ee55-40f9-8f03-e2f17b05c0b3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:35.317542 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-727048f1-ee55-40f9-8f03-e2f17b05c0b3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:35.324609 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-727048f1-ee55-40f9-8f03-e2f17b05c0b3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:35.325056 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-727048f1-ee55-40f9-8f03-e2f17b05c0b3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:35.325811 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-727048f1-ee55-40f9-8f03-e2f17b05c0b3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:35.326240 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-727048f1-ee55-40f9-8f03-e2f17b05c0b3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:35.456619 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-727048f1-ee55-40f9-8f03-e2f17b05c0b3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:35.464562 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-727048f1-ee55-40f9-8f03-e2f17b05c0b3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:35.466061 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-727048f1-ee55-40f9-8f03-e2f17b05c0b3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:35.467273 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-727048f1-ee55-40f9-8f03-e2f17b05c0b3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1723 microversion: 2.20 time: 0.154218 Aug 03 13:09:35.467833 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 492/980] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:35 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:09:36.490672 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-20f66568-2a20-4d7a-88cc-8c82433d27d8 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:36.491309 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-20f66568-2a20-4d7a-88cc-8c82433d27d8 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:36.498289 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-20f66568-2a20-4d7a-88cc-8c82433d27d8 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:36.498761 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-20f66568-2a20-4d7a-88cc-8c82433d27d8 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:36.499577 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-20f66568-2a20-4d7a-88cc-8c82433d27d8 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:36.500010 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-20f66568-2a20-4d7a-88cc-8c82433d27d8 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:36.518066 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=100 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:09:36.628382 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-20f66568-2a20-4d7a-88cc-8c82433d27d8 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:36.636997 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-20f66568-2a20-4d7a-88cc-8c82433d27d8 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:36.638473 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-20f66568-2a20-4d7a-88cc-8c82433d27d8 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:36.639639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-20f66568-2a20-4d7a-88cc-8c82433d27d8 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1723 microversion: 2.20 time: 0.152973 Aug 03 13:09:36.640237 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 489/981] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:36 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:09:37.078320 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-c09684a9-1d03-4201-8bdb-c4385606b156 req-2a1d5020-ff13-4afc-8c6a-41d665f8f16e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f0de60a-97c6-4897-a746-1c626065c1c7", "name": "network-vif-unplugged", "status": "completed", "tag": "9a26950b-91c5-47f5-a903-f189d725973f"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:09:37.088810 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-c09684a9-1d03-4201-8bdb-c4385606b156 req-2a1d5020-ff13-4afc-8c6a-41d665f8f16e service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:37.089252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-c09684a9-1d03-4201-8bdb-c4385606b156 req-2a1d5020-ff13-4afc-8c6a-41d665f8f16e service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:37.101768 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-c09684a9-1d03-4201-8bdb-c4385606b156 req-2a1d5020-ff13-4afc-8c6a-41d665f8f16e service nova] Creating event network-vif-unplugged:9a26950b-91c5-47f5-a903-f189d725973f for instance 9f0de60a-97c6-4897-a746-1c626065c1c7 on hv-cinder-85083 Aug 03 13:09:37.107982 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-c09684a9-1d03-4201-8bdb-c4385606b156 req-2a1d5020-ff13-4afc-8c6a-41d665f8f16e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032921 Aug 03 13:09:37.108598 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 493/982] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:09:37.663043 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-b6240c77-cf9a-4c0e-a274-d7acd59ecaa9 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:37.663644 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-b6240c77-cf9a-4c0e-a274-d7acd59ecaa9 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:37.670177 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b6240c77-cf9a-4c0e-a274-d7acd59ecaa9 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:37.674707 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b6240c77-cf9a-4c0e-a274-d7acd59ecaa9 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:37.674707 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b6240c77-cf9a-4c0e-a274-d7acd59ecaa9 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:37.674707 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b6240c77-cf9a-4c0e-a274-d7acd59ecaa9 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:37.799226 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b6240c77-cf9a-4c0e-a274-d7acd59ecaa9 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:37.807168 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b6240c77-cf9a-4c0e-a274-d7acd59ecaa9 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:37.808658 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b6240c77-cf9a-4c0e-a274-d7acd59ecaa9 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:37.809806 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-b6240c77-cf9a-4c0e-a274-d7acd59ecaa9 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1726 microversion: 2.20 time: 0.150963 Aug 03 13:09:37.810364 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 490/983] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:37 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:09:37.832897 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d435ad03-58c5-430d-9079-0df1f5bc0106 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "627c53ab-47eb-43ba-9cbe-07af3c9eeb86"}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:09:37.835271 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d435ad03-58c5-430d-9079-0df1f5bc0106 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:37.842210 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d435ad03-58c5-430d-9079-0df1f5bc0106 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:37.842660 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d435ad03-58c5-430d-9079-0df1f5bc0106 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:37.843456 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d435ad03-58c5-430d-9079-0df1f5bc0106 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:37.843897 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d435ad03-58c5-430d-9079-0df1f5bc0106 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:37.860217 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=100 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:09:38.655382 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d435ad03-58c5-430d-9079-0df1f5bc0106 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "POST /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.826998 Aug 03 13:09:38.656035 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 494/984] 10.222.0.64 () {62 vars in 1364 bytes} [Wed Aug 3 13:09:37 2022] POST /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7/os-volume_attachments => generated 188 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 13:09:38.780779 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-e82a9171-cec7-4eac-b359-16d6c8501c8b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:38.781319 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-e82a9171-cec7-4eac-b359-16d6c8501c8b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:38.787933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e82a9171-cec7-4eac-b359-16d6c8501c8b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:38.788386 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e82a9171-cec7-4eac-b359-16d6c8501c8b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:38.789176 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e82a9171-cec7-4eac-b359-16d6c8501c8b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:38.789611 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e82a9171-cec7-4eac-b359-16d6c8501c8b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:38.942555 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-3c09cc79-bb87-4058-ae3c-b72d36dcf65c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-633301768", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1280873694", "security_groups": [{"name": "tempest-secgroup-smoke-1310584738"}], "networks": [{"uuid": "1c551bed-f6bb-4195-bab6-0a742fa637ad"}], "block_device_mapping_v2": [{"uuid": "286223c0-73e2-4fb2-bfe4-5e898cd19500", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:09:39.058260 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.network.neutron [None req-3c09cc79-bb87-4058-ae3c-b72d36dcf65c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] validate_networks() for [('1c551bed-f6bb-4195-bab6-0a742fa637ad', None, None, None, None, None)] {{(pid=119410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 13:09:39.334429 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-e82a9171-cec7-4eac-b359-16d6c8501c8b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "DELETE /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7/os-volume_attachments/627c53ab-47eb-43ba-9cbe-07af3c9eeb86" status: 202 len: 0 microversion: 2.20 time: 0.557983 Aug 03 13:09:39.335201 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 491/985] 10.222.0.64 () {60 vars in 1457 bytes} [Wed Aug 3 13:09:38 2022] DELETE /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7/os-volume_attachments/627c53ab-47eb-43ba-9cbe-07af3c9eeb86 => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 03 13:09:39.398839 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-1e9271b2-44d8-4a4c-812d-c6a79f5fdf8b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:09:39.399434 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-1e9271b2-44d8-4a4c-812d-c6a79f5fdf8b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:39.407356 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1e9271b2-44d8-4a4c-812d-c6a79f5fdf8b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:39.407843 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1e9271b2-44d8-4a4c-812d-c6a79f5fdf8b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:39.408690 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1e9271b2-44d8-4a4c-812d-c6a79f5fdf8b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:39.409335 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1e9271b2-44d8-4a4c-812d-c6a79f5fdf8b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:39.515852 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-1e9271b2-44d8-4a4c-812d-c6a79f5fdf8b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119409) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 03 13:09:39.666361 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-3c09cc79-bb87-4058-ae3c-b72d36dcf65c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Flavor limits 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 13:09:39.666893 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-3c09cc79-bb87-4058-ae3c-b72d36dcf65c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Image limits 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 13:09:39.667290 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-3c09cc79-bb87-4058-ae3c-b72d36dcf65c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Flavor pref 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 13:09:39.667806 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-3c09cc79-bb87-4058-ae3c-b72d36dcf65c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Image pref 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 13:09:39.668228 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-3c09cc79-bb87-4058-ae3c-b72d36dcf65c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 13:09:39.677045 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3c09cc79-bb87-4058-ae3c-b72d36dcf65c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:39.677492 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3c09cc79-bb87-4058-ae3c-b72d36dcf65c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:39.678294 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3c09cc79-bb87-4058-ae3c-b72d36dcf65c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:39.678759 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3c09cc79-bb87-4058-ae3c-b72d36dcf65c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:39.695939 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.quota [None req-3c09cc79-bb87-4058-ae3c-b72d36dcf65c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Getting quotas for project 8d0b838da49141f99cb5073f13024892. Resources: {'instances', 'ram', 'cores'} {{(pid=119410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 13:09:39.700618 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.quota [None req-3c09cc79-bb87-4058-ae3c-b72d36dcf65c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Getting quotas for user 5094778e88de495d96981c16da9ee916 and project 8d0b838da49141f99cb5073f13024892. Resources: {'instances', 'ram', 'cores'} {{(pid=119410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 13:09:39.757788 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-3c09cc79-bb87-4058-ae3c-b72d36dcf65c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Going to run 1 instances... {{(pid=119410) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 13:09:39.759999 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-3c09cc79-bb87-4058-ae3c-b72d36dcf65c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='286223c0-73e2-4fb2-bfe4-5e898cd19500',volume_size=None,volume_type=None)] {{(pid=119410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 13:09:39.783781 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-1e9271b2-44d8-4a4c-812d-c6a79f5fdf8b tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "POST /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7/action" status: 202 len: 0 microversion: 2.20 time: 0.388970 Aug 03 13:09:39.784392 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 492/986] 10.222.0.64 () {62 vars in 1319 bytes} [Wed Aug 3 13:09:39 2022] POST /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 03 13:09:39.793151 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-83759c86-ccca-4d8e-b17e-5af20de28142 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:39.793755 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-83759c86-ccca-4d8e-b17e-5af20de28142 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:39.802219 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-83759c86-ccca-4d8e-b17e-5af20de28142 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:39.802861 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-83759c86-ccca-4d8e-b17e-5af20de28142 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:39.803726 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-83759c86-ccca-4d8e-b17e-5af20de28142 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:39.804164 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-83759c86-ccca-4d8e-b17e-5af20de28142 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:39.937899 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-83759c86-ccca-4d8e-b17e-5af20de28142 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:39.945733 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-83759c86-ccca-4d8e-b17e-5af20de28142 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:39.947256 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-83759c86-ccca-4d8e-b17e-5af20de28142 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:39.948397 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-83759c86-ccca-4d8e-b17e-5af20de28142 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1674 microversion: 2.20 time: 0.159452 Aug 03 13:09:39.948987 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 493/987] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:39 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:09:40.167124 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-3c09cc79-bb87-4058-ae3c-b72d36dcf65c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.228450 Aug 03 13:09:40.168297 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 495/988] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 3 13:09:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 1230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 13:09:40.179114 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-396cd56f-af45-4fef-abd6-5d96926125c0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:40.179728 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-396cd56f-af45-4fef-abd6-5d96926125c0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:40.238310 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-396cd56f-af45-4fef-abd6-5d96926125c0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:40.245590 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-396cd56f-af45-4fef-abd6-5d96926125c0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1088 microversion: 2.1 time: 0.070231 Aug 03 13:09:40.246301 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 494/989] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:40 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1088 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:09:41.118838 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-a8d2b062-1544-44db-aa98-ef6d09110da4 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:41.119465 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-a8d2b062-1544-44db-aa98-ef6d09110da4 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:41.127440 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a8d2b062-1544-44db-aa98-ef6d09110da4 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:41.127903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a8d2b062-1544-44db-aa98-ef6d09110da4 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:41.128681 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a8d2b062-1544-44db-aa98-ef6d09110da4 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:41.129267 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a8d2b062-1544-44db-aa98-ef6d09110da4 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:41.266951 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-fb031928-8bd6-45a5-ab3a-498aba7c1994 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:41.267562 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-fb031928-8bd6-45a5-ab3a-498aba7c1994 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:41.273410 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-a8d2b062-1544-44db-aa98-ef6d09110da4 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:41.280398 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fb031928-8bd6-45a5-ab3a-498aba7c1994 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:41.280854 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fb031928-8bd6-45a5-ab3a-498aba7c1994 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:41.281623 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fb031928-8bd6-45a5-ab3a-498aba7c1994 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:41.282059 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fb031928-8bd6-45a5-ab3a-498aba7c1994 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:41.283085 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-a8d2b062-1544-44db-aa98-ef6d09110da4 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:41.284581 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-a8d2b062-1544-44db-aa98-ef6d09110da4 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:41.285998 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-a8d2b062-1544-44db-aa98-ef6d09110da4 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1676 microversion: 2.20 time: 0.317094 Aug 03 13:09:41.286560 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 496/990] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:40 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1676 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:09:41.342944 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-fb031928-8bd6-45a5-ab3a-498aba7c1994 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:41.350673 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-fb031928-8bd6-45a5-ab3a-498aba7c1994 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1138 microversion: 2.1 time: 0.087789 Aug 03 13:09:41.351289 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 495/991] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:41 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1138 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:09:42.309113 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1cb5efff-6798-444c-9a4e-5ee51d4f8e13 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:42.309721 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-1cb5efff-6798-444c-9a4e-5ee51d4f8e13 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:42.316524 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1cb5efff-6798-444c-9a4e-5ee51d4f8e13 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:42.316980 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1cb5efff-6798-444c-9a4e-5ee51d4f8e13 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:42.317734 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1cb5efff-6798-444c-9a4e-5ee51d4f8e13 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:42.318161 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1cb5efff-6798-444c-9a4e-5ee51d4f8e13 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:42.372076 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ebc23ba7-9065-437a-9196-e33d481fcace tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:42.372755 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-ebc23ba7-9065-437a-9196-e33d481fcace tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:42.380353 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ebc23ba7-9065-437a-9196-e33d481fcace tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:42.381587 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ebc23ba7-9065-437a-9196-e33d481fcace tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:42.382521 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ebc23ba7-9065-437a-9196-e33d481fcace tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:42.382973 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ebc23ba7-9065-437a-9196-e33d481fcace tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:42.458419 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ebc23ba7-9065-437a-9196-e33d481fcace tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:42.467532 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-ebc23ba7-9065-437a-9196-e33d481fcace tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1194 microversion: 2.1 time: 0.099554 Aug 03 13:09:42.468716 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 496/992] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:42 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1194 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:09:42.499157 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-1cb5efff-6798-444c-9a4e-5ee51d4f8e13 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:42.510614 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-1cb5efff-6798-444c-9a4e-5ee51d4f8e13 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:42.513205 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-1cb5efff-6798-444c-9a4e-5ee51d4f8e13 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:42.514603 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-1cb5efff-6798-444c-9a4e-5ee51d4f8e13 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1732 microversion: 2.20 time: 0.209469 Aug 03 13:09:42.515671 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 497/993] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:42 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1732 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:09:43.492792 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-7490b05d-c448-4421-896e-12ea2ea01c39 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:43.493485 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-7490b05d-c448-4421-896e-12ea2ea01c39 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:43.501044 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7490b05d-c448-4421-896e-12ea2ea01c39 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:43.503313 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7490b05d-c448-4421-896e-12ea2ea01c39 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:43.504212 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7490b05d-c448-4421-896e-12ea2ea01c39 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:43.504658 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7490b05d-c448-4421-896e-12ea2ea01c39 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:43.537615 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-75c69425-57e8-4511-8985-af22556112cf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:43.538675 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-75c69425-57e8-4511-8985-af22556112cf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:43.547394 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-75c69425-57e8-4511-8985-af22556112cf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:43.548029 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-75c69425-57e8-4511-8985-af22556112cf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:43.549217 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-75c69425-57e8-4511-8985-af22556112cf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:43.549885 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-75c69425-57e8-4511-8985-af22556112cf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:43.744254 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-7490b05d-c448-4421-896e-12ea2ea01c39 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:43.753668 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-7490b05d-c448-4421-896e-12ea2ea01c39 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1272 microversion: 2.1 time: 0.264966 Aug 03 13:09:43.754702 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 497/994] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:43 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1272 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:09:43.802077 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-75c69425-57e8-4511-8985-af22556112cf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:43.810331 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-75c69425-57e8-4511-8985-af22556112cf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:43.811875 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-75c69425-57e8-4511-8985-af22556112cf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:43.813102 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-75c69425-57e8-4511-8985-af22556112cf tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1732 microversion: 2.20 time: 0.279575 Aug 03 13:09:43.813673 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 498/995] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:43 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1732 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:09:44.779941 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-0b534834-0b98-436d-9c8f-5199c7d63927 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:44.780531 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-0b534834-0b98-436d-9c8f-5199c7d63927 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:44.788207 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0b534834-0b98-436d-9c8f-5199c7d63927 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:44.788654 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0b534834-0b98-436d-9c8f-5199c7d63927 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:44.789645 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0b534834-0b98-436d-9c8f-5199c7d63927 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:44.790082 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0b534834-0b98-436d-9c8f-5199c7d63927 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:44.836490 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-60eaed2c-c957-4ae7-95f8-9c6202128342 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:44.837305 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-60eaed2c-c957-4ae7-95f8-9c6202128342 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:44.844367 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-60eaed2c-c957-4ae7-95f8-9c6202128342 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:44.844810 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-60eaed2c-c957-4ae7-95f8-9c6202128342 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:44.845570 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-60eaed2c-c957-4ae7-95f8-9c6202128342 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:44.845999 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-60eaed2c-c957-4ae7-95f8-9c6202128342 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:45.006463 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-0b534834-0b98-436d-9c8f-5199c7d63927 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:45.015654 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-0b534834-0b98-436d-9c8f-5199c7d63927 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1272 microversion: 2.1 time: 0.240026 Aug 03 13:09:45.026135 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 498/996] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:44 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1272 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:09:45.035379 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-60eaed2c-c957-4ae7-95f8-9c6202128342 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:45.043745 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-60eaed2c-c957-4ae7-95f8-9c6202128342 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:45.045262 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-60eaed2c-c957-4ae7-95f8-9c6202128342 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:45.046441 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-60eaed2c-c957-4ae7-95f8-9c6202128342 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1732 microversion: 2.20 time: 0.213957 Aug 03 13:09:45.047232 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 499/997] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:44 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1732 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:09:46.036842 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-274ee1f4-3c34-46dd-9e83-6cb7e435daf8 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:46.037450 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-274ee1f4-3c34-46dd-9e83-6cb7e435daf8 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:46.044525 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-274ee1f4-3c34-46dd-9e83-6cb7e435daf8 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:46.044969 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-274ee1f4-3c34-46dd-9e83-6cb7e435daf8 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:46.045724 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-274ee1f4-3c34-46dd-9e83-6cb7e435daf8 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:46.046158 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-274ee1f4-3c34-46dd-9e83-6cb7e435daf8 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:46.070491 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-07b6c804-c291-4bf0-bc6e-86af501615f3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:46.071800 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-07b6c804-c291-4bf0-bc6e-86af501615f3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:46.079089 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-07b6c804-c291-4bf0-bc6e-86af501615f3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:46.079952 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-07b6c804-c291-4bf0-bc6e-86af501615f3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:46.080927 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-07b6c804-c291-4bf0-bc6e-86af501615f3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:46.081559 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-07b6c804-c291-4bf0-bc6e-86af501615f3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:46.258903 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-274ee1f4-3c34-46dd-9e83-6cb7e435daf8 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:46.267689 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-274ee1f4-3c34-46dd-9e83-6cb7e435daf8 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1272 microversion: 2.1 time: 0.234957 Aug 03 13:09:46.278778 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 499/998] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:46 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1272 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:09:46.289785 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-07b6c804-c291-4bf0-bc6e-86af501615f3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:46.299018 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-07b6c804-c291-4bf0-bc6e-86af501615f3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:46.300922 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-07b6c804-c291-4bf0-bc6e-86af501615f3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:46.302341 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-07b6c804-c291-4bf0-bc6e-86af501615f3 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1732 microversion: 2.20 time: 0.235995 Aug 03 13:09:46.316211 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 500/999] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:46 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1732 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:09:47.289994 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-7b2d5d68-8228-4f76-9320-8f9ef90b8bb7 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:47.290830 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-7b2d5d68-8228-4f76-9320-8f9ef90b8bb7 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:47.297859 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7b2d5d68-8228-4f76-9320-8f9ef90b8bb7 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:47.298310 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7b2d5d68-8228-4f76-9320-8f9ef90b8bb7 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:47.299112 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7b2d5d68-8228-4f76-9320-8f9ef90b8bb7 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:47.299549 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7b2d5d68-8228-4f76-9320-8f9ef90b8bb7 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:47.327496 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d3c3265c-0513-4338-86df-c77c467117ea tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:47.328802 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d3c3265c-0513-4338-86df-c77c467117ea tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:47.335990 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d3c3265c-0513-4338-86df-c77c467117ea tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:47.336533 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d3c3265c-0513-4338-86df-c77c467117ea tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:47.337372 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d3c3265c-0513-4338-86df-c77c467117ea tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:47.337813 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d3c3265c-0513-4338-86df-c77c467117ea tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:47.492821 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-7b2d5d68-8228-4f76-9320-8f9ef90b8bb7 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:47.501671 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-7b2d5d68-8228-4f76-9320-8f9ef90b8bb7 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1272 microversion: 2.1 time: 0.216123 Aug 03 13:09:47.502604 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 500/1000] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:47 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1272 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:09:47.516897 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d3c3265c-0513-4338-86df-c77c467117ea tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:47.536159 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d3c3265c-0513-4338-86df-c77c467117ea tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:47.537847 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d3c3265c-0513-4338-86df-c77c467117ea tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:47.539186 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d3c3265c-0513-4338-86df-c77c467117ea tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1732 microversion: 2.20 time: 0.216160 Aug 03 13:09:47.539976 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 501/1001] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:47 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1732 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:09:48.523874 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-f60a40c8-7153-46a5-863d-d41e8e53d2df tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:48.524486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-f60a40c8-7153-46a5-863d-d41e8e53d2df tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:48.532436 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f60a40c8-7153-46a5-863d-d41e8e53d2df tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:48.532874 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f60a40c8-7153-46a5-863d-d41e8e53d2df tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:48.533791 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f60a40c8-7153-46a5-863d-d41e8e53d2df tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:48.534275 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f60a40c8-7153-46a5-863d-d41e8e53d2df tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:48.562200 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-702c05a1-1289-4d43-b01c-7639f60d811d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:48.563615 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-702c05a1-1289-4d43-b01c-7639f60d811d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:48.576213 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-702c05a1-1289-4d43-b01c-7639f60d811d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:48.576607 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-702c05a1-1289-4d43-b01c-7639f60d811d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:48.577393 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-702c05a1-1289-4d43-b01c-7639f60d811d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:48.577851 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-702c05a1-1289-4d43-b01c-7639f60d811d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:48.741850 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-f60a40c8-7153-46a5-863d-d41e8e53d2df tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:48.751525 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-f60a40c8-7153-46a5-863d-d41e8e53d2df tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1272 microversion: 2.1 time: 0.231367 Aug 03 13:09:48.752566 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 501/1002] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:48 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1272 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:09:48.770941 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-702c05a1-1289-4d43-b01c-7639f60d811d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:48.779757 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-702c05a1-1289-4d43-b01c-7639f60d811d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:48.781327 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-702c05a1-1289-4d43-b01c-7639f60d811d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:48.782481 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-702c05a1-1289-4d43-b01c-7639f60d811d tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1732 microversion: 2.20 time: 0.224756 Aug 03 13:09:48.785540 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 502/1003] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:48 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1732 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:09:49.772247 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-c6f153dc-7ee0-4182-b3fb-96f9a754ed11 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:49.772841 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-c6f153dc-7ee0-4182-b3fb-96f9a754ed11 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:49.779644 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c6f153dc-7ee0-4182-b3fb-96f9a754ed11 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:49.780082 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c6f153dc-7ee0-4182-b3fb-96f9a754ed11 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:49.780822 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c6f153dc-7ee0-4182-b3fb-96f9a754ed11 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:49.781247 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c6f153dc-7ee0-4182-b3fb-96f9a754ed11 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:49.807763 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-cdf069e3-c6d9-4163-a891-0412fd77f7f9 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:49.809773 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-cdf069e3-c6d9-4163-a891-0412fd77f7f9 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:49.817591 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=2 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:09:49.819797 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=6 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:09:49.821813 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cdf069e3-c6d9-4163-a891-0412fd77f7f9 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:49.822825 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cdf069e3-c6d9-4163-a891-0412fd77f7f9 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:49.824581 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cdf069e3-c6d9-4163-a891-0412fd77f7f9 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:49.825438 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cdf069e3-c6d9-4163-a891-0412fd77f7f9 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:49.999624 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-c6f153dc-7ee0-4182-b3fb-96f9a754ed11 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:50.007667 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-c6f153dc-7ee0-4182-b3fb-96f9a754ed11 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1272 microversion: 2.1 time: 0.239244 Aug 03 13:09:50.008770 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 502/1004] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:49 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1272 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:09:50.024256 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-cdf069e3-c6d9-4163-a891-0412fd77f7f9 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:50.032428 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-cdf069e3-c6d9-4163-a891-0412fd77f7f9 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:50.033996 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-cdf069e3-c6d9-4163-a891-0412fd77f7f9 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:50.035556 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-cdf069e3-c6d9-4163-a891-0412fd77f7f9 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1732 microversion: 2.20 time: 0.232859 Aug 03 13:09:50.036156 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 503/1005] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:49 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1732 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:09:51.030584 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-19c94dfb-d6ec-4ed2-8f55-96a9933c6c26 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:51.031262 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-19c94dfb-d6ec-4ed2-8f55-96a9933c6c26 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:51.033144 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell0:SELECT=2 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:09:51.039322 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-19c94dfb-d6ec-4ed2-8f55-96a9933c6c26 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:51.039774 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-19c94dfb-d6ec-4ed2-8f55-96a9933c6c26 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:51.040542 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-19c94dfb-d6ec-4ed2-8f55-96a9933c6c26 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:51.040977 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-19c94dfb-d6ec-4ed2-8f55-96a9933c6c26 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:51.060005 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-c721d309-9c6a-4982-bdd2-6711629a3b87 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:51.061396 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-c721d309-9c6a-4982-bdd2-6711629a3b87 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:51.068268 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c721d309-9c6a-4982-bdd2-6711629a3b87 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:51.074234 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c721d309-9c6a-4982-bdd2-6711629a3b87 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:51.074234 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c721d309-9c6a-4982-bdd2-6711629a3b87 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:51.074234 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c721d309-9c6a-4982-bdd2-6711629a3b87 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:51.266855 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-19c94dfb-d6ec-4ed2-8f55-96a9933c6c26 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:51.273061 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:09:51.275828 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-19c94dfb-d6ec-4ed2-8f55-96a9933c6c26 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1272 microversion: 2.1 time: 0.249951 Aug 03 13:09:51.284955 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c721d309-9c6a-4982-bdd2-6711629a3b87 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:51.286489 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 503/1006] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:51 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1272 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:09:51.307628 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c721d309-9c6a-4982-bdd2-6711629a3b87 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:51.309485 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c721d309-9c6a-4982-bdd2-6711629a3b87 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:51.310882 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-c721d309-9c6a-4982-bdd2-6711629a3b87 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1732 microversion: 2.20 time: 0.256140 Aug 03 13:09:51.311822 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 504/1007] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:51 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1732 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:09:52.308909 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-17d82585-63b6-4b14-8fe4-a334e7ba4288 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:52.309541 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-17d82585-63b6-4b14-8fe4-a334e7ba4288 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:52.316685 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-17d82585-63b6-4b14-8fe4-a334e7ba4288 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:52.317139 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-17d82585-63b6-4b14-8fe4-a334e7ba4288 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:52.317895 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-17d82585-63b6-4b14-8fe4-a334e7ba4288 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:52.318327 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-17d82585-63b6-4b14-8fe4-a334e7ba4288 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:52.334636 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-cb6f31e3-d91c-4be6-8a3b-6a1aa21f163e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:52.335278 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-cb6f31e3-d91c-4be6-8a3b-6a1aa21f163e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:52.341910 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cb6f31e3-d91c-4be6-8a3b-6a1aa21f163e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:52.342411 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cb6f31e3-d91c-4be6-8a3b-6a1aa21f163e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:52.343215 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cb6f31e3-d91c-4be6-8a3b-6a1aa21f163e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:52.343853 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cb6f31e3-d91c-4be6-8a3b-6a1aa21f163e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:52.514178 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-17d82585-63b6-4b14-8fe4-a334e7ba4288 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:52.520944 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-cb6f31e3-d91c-4be6-8a3b-6a1aa21f163e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:52.521615 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-17d82585-63b6-4b14-8fe4-a334e7ba4288 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1272 microversion: 2.1 time: 0.217643 Aug 03 13:09:52.522222 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 504/1008] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:52 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1272 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:09:52.529074 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-cb6f31e3-d91c-4be6-8a3b-6a1aa21f163e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:52.530581 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-cb6f31e3-d91c-4be6-8a3b-6a1aa21f163e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:52.531780 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-cb6f31e3-d91c-4be6-8a3b-6a1aa21f163e tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1732 microversion: 2.20 time: 0.201101 Aug 03 13:09:52.532335 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 505/1009] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:52 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1732 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:09:53.542000 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-69d74671-8bd2-42ba-b83a-93e99cbe8583 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:53.543167 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-69d74671-8bd2-42ba-b83a-93e99cbe8583 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:53.549747 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-69d74671-8bd2-42ba-b83a-93e99cbe8583 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:53.550131 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-69d74671-8bd2-42ba-b83a-93e99cbe8583 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:53.550933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-69d74671-8bd2-42ba-b83a-93e99cbe8583 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:53.551366 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-69d74671-8bd2-42ba-b83a-93e99cbe8583 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:53.554629 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-50ce497d-9b3e-4326-bff1-5bc842da2a59 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:53.555305 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-50ce497d-9b3e-4326-bff1-5bc842da2a59 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:53.562383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-50ce497d-9b3e-4326-bff1-5bc842da2a59 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:53.562861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-50ce497d-9b3e-4326-bff1-5bc842da2a59 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:53.563621 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-50ce497d-9b3e-4326-bff1-5bc842da2a59 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:53.564051 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-50ce497d-9b3e-4326-bff1-5bc842da2a59 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:53.750485 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-69d74671-8bd2-42ba-b83a-93e99cbe8583 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:53.756839 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-50ce497d-9b3e-4326-bff1-5bc842da2a59 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:53.757260 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-69d74671-8bd2-42ba-b83a-93e99cbe8583 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1272 microversion: 2.1 time: 0.219026 Aug 03 13:09:53.757835 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 505/1010] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:53 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1272 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:09:53.764921 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-50ce497d-9b3e-4326-bff1-5bc842da2a59 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:53.766423 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-50ce497d-9b3e-4326-bff1-5bc842da2a59 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:53.767659 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-50ce497d-9b3e-4326-bff1-5bc842da2a59 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1732 microversion: 2.20 time: 0.216930 Aug 03 13:09:53.768408 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 506/1011] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:53 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1732 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:09:54.779138 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-bee211f6-70e9-45f5-a129-31a6b9b14393 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:54.779775 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-bee211f6-70e9-45f5-a129-31a6b9b14393 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:54.786568 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bee211f6-70e9-45f5-a129-31a6b9b14393 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:54.787046 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bee211f6-70e9-45f5-a129-31a6b9b14393 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:54.787806 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bee211f6-70e9-45f5-a129-31a6b9b14393 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:54.788235 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bee211f6-70e9-45f5-a129-31a6b9b14393 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:54.791364 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-087f6c75-7849-4548-ba23-a6904d629013 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:54.791981 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-087f6c75-7849-4548-ba23-a6904d629013 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:54.798406 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-087f6c75-7849-4548-ba23-a6904d629013 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:54.798988 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-087f6c75-7849-4548-ba23-a6904d629013 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:54.799763 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-087f6c75-7849-4548-ba23-a6904d629013 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:54.800206 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-087f6c75-7849-4548-ba23-a6904d629013 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:54.988390 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-bee211f6-70e9-45f5-a129-31a6b9b14393 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:54.996232 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-087f6c75-7849-4548-ba23-a6904d629013 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:54.996593 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-bee211f6-70e9-45f5-a129-31a6b9b14393 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1272 microversion: 2.1 time: 0.221308 Aug 03 13:09:54.997163 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 506/1012] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:54 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1272 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:09:55.004381 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-087f6c75-7849-4548-ba23-a6904d629013 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:55.005880 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-087f6c75-7849-4548-ba23-a6904d629013 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:55.007107 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-087f6c75-7849-4548-ba23-a6904d629013 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1732 microversion: 2.20 time: 0.219580 Aug 03 13:09:55.007658 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 507/1013] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:54 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1732 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:09:56.017797 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d9adad72-256f-4ad3-ba79-d72f47da1f3e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:56.018408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-d9adad72-256f-4ad3-ba79-d72f47da1f3e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:56.024921 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d9adad72-256f-4ad3-ba79-d72f47da1f3e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:56.025374 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d9adad72-256f-4ad3-ba79-d72f47da1f3e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:56.026137 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d9adad72-256f-4ad3-ba79-d72f47da1f3e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:56.026805 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d9adad72-256f-4ad3-ba79-d72f47da1f3e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:56.031695 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-51cbd8f7-00b3-4913-94f9-1a1c0fcbd2b2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:56.032302 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-51cbd8f7-00b3-4913-94f9-1a1c0fcbd2b2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:56.039045 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-51cbd8f7-00b3-4913-94f9-1a1c0fcbd2b2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:56.039498 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-51cbd8f7-00b3-4913-94f9-1a1c0fcbd2b2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:56.040259 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-51cbd8f7-00b3-4913-94f9-1a1c0fcbd2b2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:56.040694 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-51cbd8f7-00b3-4913-94f9-1a1c0fcbd2b2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:56.236942 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-d9adad72-256f-4ad3-ba79-d72f47da1f3e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:56.244705 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-51cbd8f7-00b3-4913-94f9-1a1c0fcbd2b2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:56.247025 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-d9adad72-256f-4ad3-ba79-d72f47da1f3e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1272 microversion: 2.1 time: 0.232764 Aug 03 13:09:56.247778 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 507/1014] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:56 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1272 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:09:56.258326 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-51cbd8f7-00b3-4913-94f9-1a1c0fcbd2b2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:56.259931 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-51cbd8f7-00b3-4913-94f9-1a1c0fcbd2b2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:56.261720 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-51cbd8f7-00b3-4913-94f9-1a1c0fcbd2b2 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1732 microversion: 2.20 time: 0.233292 Aug 03 13:09:56.263280 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 508/1015] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:56 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1732 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:09:57.268319 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-6f094dc7-2281-4b30-aa81-fc887ceff811 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:57.269566 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-6f094dc7-2281-4b30-aa81-fc887ceff811 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:57.276181 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6f094dc7-2281-4b30-aa81-fc887ceff811 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:57.277301 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6f094dc7-2281-4b30-aa81-fc887ceff811 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:57.278068 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6f094dc7-2281-4b30-aa81-fc887ceff811 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:57.278508 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6f094dc7-2281-4b30-aa81-fc887ceff811 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:57.286002 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-7889074f-3436-4072-841e-e8bc1e34ddec tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:57.286819 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-7889074f-3436-4072-841e-e8bc1e34ddec tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:57.293795 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7889074f-3436-4072-841e-e8bc1e34ddec tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:57.294681 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7889074f-3436-4072-841e-e8bc1e34ddec tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:57.295613 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7889074f-3436-4072-841e-e8bc1e34ddec tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:57.296115 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7889074f-3436-4072-841e-e8bc1e34ddec tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:57.300666 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:09:57.494293 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-6f094dc7-2281-4b30-aa81-fc887ceff811 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:57.499265 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-7889074f-3436-4072-841e-e8bc1e34ddec tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:57.503651 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-6f094dc7-2281-4b30-aa81-fc887ceff811 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1272 microversion: 2.1 time: 0.238914 Aug 03 13:09:57.507166 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 508/1016] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:57 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1272 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:09:57.510096 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-7889074f-3436-4072-841e-e8bc1e34ddec tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:57.511861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-7889074f-3436-4072-841e-e8bc1e34ddec tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:57.513320 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-7889074f-3436-4072-841e-e8bc1e34ddec tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1732 microversion: 2.20 time: 0.231757 Aug 03 13:09:57.519783 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 509/1017] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:57 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1732 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:09:57.681952 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-55311c7e-7a38-4b02-aa35-34357490c3f1 req-4ac5d692-cdbc-4e30-ad4b-3c991a8de1e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1370967-b0b8-4afe-99a9-142716f118bb", "tag": "12ced69b-7cb0-4bac-a7d5-0b77dc4d6f10"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:09:57.691955 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-55311c7e-7a38-4b02-aa35-34357490c3f1 req-4ac5d692-cdbc-4e30-ad4b-3c991a8de1e8 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:57.692401 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-55311c7e-7a38-4b02-aa35-34357490c3f1 req-4ac5d692-cdbc-4e30-ad4b-3c991a8de1e8 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:57.703158 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-55311c7e-7a38-4b02-aa35-34357490c3f1 req-4ac5d692-cdbc-4e30-ad4b-3c991a8de1e8 service nova] Creating event network-changed:12ced69b-7cb0-4bac-a7d5-0b77dc4d6f10 for instance b1370967-b0b8-4afe-99a9-142716f118bb on hv-cinder-85083 Aug 03 13:09:57.707991 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-55311c7e-7a38-4b02-aa35-34357490c3f1 req-4ac5d692-cdbc-4e30-ad4b-3c991a8de1e8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029899 Aug 03 13:09:57.708784 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 509/1018] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:09:58.524612 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-5b40ea91-358b-4cb3-853e-81f3c85f6fde tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:58.525225 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-5b40ea91-358b-4cb3-853e-81f3c85f6fde tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:58.532403 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5b40ea91-358b-4cb3-853e-81f3c85f6fde tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:58.532857 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5b40ea91-358b-4cb3-853e-81f3c85f6fde tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:58.533644 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5b40ea91-358b-4cb3-853e-81f3c85f6fde tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:58.534080 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5b40ea91-358b-4cb3-853e-81f3c85f6fde tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:58.536709 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ca5bc9b2-9adc-48f7-9355-28ec515ab7bc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:58.537389 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-ca5bc9b2-9adc-48f7-9355-28ec515ab7bc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:58.544055 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ca5bc9b2-9adc-48f7-9355-28ec515ab7bc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:58.544494 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ca5bc9b2-9adc-48f7-9355-28ec515ab7bc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:58.545264 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ca5bc9b2-9adc-48f7-9355-28ec515ab7bc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:58.545704 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ca5bc9b2-9adc-48f7-9355-28ec515ab7bc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:58.734772 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-5b40ea91-358b-4cb3-853e-81f3c85f6fde tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:58.737824 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ca5bc9b2-9adc-48f7-9355-28ec515ab7bc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:58.742508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-5b40ea91-358b-4cb3-853e-81f3c85f6fde tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1260 microversion: 2.1 time: 0.221673 Aug 03 13:09:58.743118 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 510/1019] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:58 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1260 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:09:58.746014 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ca5bc9b2-9adc-48f7-9355-28ec515ab7bc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:58.747538 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ca5bc9b2-9adc-48f7-9355-28ec515ab7bc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:58.748775 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-ca5bc9b2-9adc-48f7-9355-28ec515ab7bc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1732 microversion: 2.20 time: 0.217181 Aug 03 13:09:58.749312 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 510/1020] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:58 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1732 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:09:59.763989 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-ab0ce5d5-0283-4767-93d2-58ff3b1b1185 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:59.764607 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-ab0ce5d5-0283-4767-93d2-58ff3b1b1185 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:59.771238 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ab0ce5d5-0283-4767-93d2-58ff3b1b1185 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:59.771692 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ab0ce5d5-0283-4767-93d2-58ff3b1b1185 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:59.772226 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-033473c8-8c11-4e41-81b6-1980272815e6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:09:59.772616 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ab0ce5d5-0283-4767-93d2-58ff3b1b1185 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:59.772831 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-033473c8-8c11-4e41-81b6-1980272815e6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:09:59.772956 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ab0ce5d5-0283-4767-93d2-58ff3b1b1185 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:59.775295 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:09:59.780279 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-033473c8-8c11-4e41-81b6-1980272815e6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:59.780729 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-033473c8-8c11-4e41-81b6-1980272815e6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:59.781502 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-033473c8-8c11-4e41-81b6-1980272815e6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:09:59.781936 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-033473c8-8c11-4e41-81b6-1980272815e6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:09:59.977582 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ab0ce5d5-0283-4767-93d2-58ff3b1b1185 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:59.981572 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-033473c8-8c11-4e41-81b6-1980272815e6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:59.985785 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-ab0ce5d5-0283-4767-93d2-58ff3b1b1185 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1260 microversion: 2.1 time: 0.226213 Aug 03 13:09:59.986384 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 511/1021] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:09:59 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1260 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:09:59.990250 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-033473c8-8c11-4e41-81b6-1980272815e6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:59.991926 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-033473c8-8c11-4e41-81b6-1980272815e6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:09:59.993159 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-033473c8-8c11-4e41-81b6-1980272815e6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1732 microversion: 2.20 time: 0.224772 Aug 03 13:09:59.993786 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 511/1022] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:09:59 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1732 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:10:01.005658 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-019c83c8-b615-408c-a299-101f7028f827 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:10:01.006337 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-019c83c8-b615-408c-a299-101f7028f827 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:10:01.013053 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-019c83c8-b615-408c-a299-101f7028f827 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:01.013497 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-019c83c8-b615-408c-a299-101f7028f827 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:01.014272 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-019c83c8-b615-408c-a299-101f7028f827 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:01.014709 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-019c83c8-b615-408c-a299-101f7028f827 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:01.016527 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-b35d1d52-6f2e-4613-a6c4-bb8e3ff24c23 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:10:01.017133 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-b35d1d52-6f2e-4613-a6c4-bb8e3ff24c23 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:10:01.023544 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b35d1d52-6f2e-4613-a6c4-bb8e3ff24c23 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:01.023986 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b35d1d52-6f2e-4613-a6c4-bb8e3ff24c23 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:01.024760 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b35d1d52-6f2e-4613-a6c4-bb8e3ff24c23 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:01.025186 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b35d1d52-6f2e-4613-a6c4-bb8e3ff24c23 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:01.215673 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-019c83c8-b615-408c-a299-101f7028f827 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:10:01.222514 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b35d1d52-6f2e-4613-a6c4-bb8e3ff24c23 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:10:01.223691 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-019c83c8-b615-408c-a299-101f7028f827 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1260 microversion: 2.1 time: 0.221819 Aug 03 13:10:01.224501 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 512/1023] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:10:01 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1260 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:10:01.231338 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b35d1d52-6f2e-4613-a6c4-bb8e3ff24c23 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:10:01.232848 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b35d1d52-6f2e-4613-a6c4-bb8e3ff24c23 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:10:01.234345 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-b35d1d52-6f2e-4613-a6c4-bb8e3ff24c23 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1732 microversion: 2.20 time: 0.221322 Aug 03 13:10:01.235094 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 512/1024] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:10:01 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1732 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:10:01.274948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-8aa74127-946f-454d-bbbc-abc42551be7a req-22e47087-ca14-4a7e-8675-d811737819d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f0de60a-97c6-4897-a746-1c626065c1c7", "name": "network-vif-plugged", "status": "completed", "tag": "9a26950b-91c5-47f5-a903-f189d725973f"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:10:01.285145 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-8aa74127-946f-454d-bbbc-abc42551be7a req-22e47087-ca14-4a7e-8675-d811737819d7 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:01.285840 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-8aa74127-946f-454d-bbbc-abc42551be7a req-22e47087-ca14-4a7e-8675-d811737819d7 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:01.298903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-8aa74127-946f-454d-bbbc-abc42551be7a req-22e47087-ca14-4a7e-8675-d811737819d7 service nova] Creating event network-vif-plugged:9a26950b-91c5-47f5-a903-f189d725973f for instance 9f0de60a-97c6-4897-a746-1c626065c1c7 on hv-cinder-85083 Aug 03 13:10:01.304020 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-8aa74127-946f-454d-bbbc-abc42551be7a req-22e47087-ca14-4a7e-8675-d811737819d7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032725 Aug 03 13:10:01.310290 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 513/1025] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:10:02.244479 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-13602d13-5ebf-4d45-8662-a52fc45b3f41 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:10:02.245033 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-13602d13-5ebf-4d45-8662-a52fc45b3f41 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:10:02.252029 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-13602d13-5ebf-4d45-8662-a52fc45b3f41 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:02.252480 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-13602d13-5ebf-4d45-8662-a52fc45b3f41 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:02.253241 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-13602d13-5ebf-4d45-8662-a52fc45b3f41 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:02.253673 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-13602d13-5ebf-4d45-8662-a52fc45b3f41 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:02.257613 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-45793a96-aee6-4279-afdf-c067cba35ee0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:10:02.258327 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-45793a96-aee6-4279-afdf-c067cba35ee0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:10:02.265583 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-45793a96-aee6-4279-afdf-c067cba35ee0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:02.266033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-45793a96-aee6-4279-afdf-c067cba35ee0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:02.266808 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-45793a96-aee6-4279-afdf-c067cba35ee0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:02.267240 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-45793a96-aee6-4279-afdf-c067cba35ee0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:02.449204 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-13602d13-5ebf-4d45-8662-a52fc45b3f41 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:10:02.456656 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-13602d13-5ebf-4d45-8662-a52fc45b3f41 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1260 microversion: 2.1 time: 0.216105 Aug 03 13:10:02.457416 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 513/1026] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:10:02 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1260 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:10:02.460079 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-45793a96-aee6-4279-afdf-c067cba35ee0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:10:02.468259 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-45793a96-aee6-4279-afdf-c067cba35ee0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:10:02.469873 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-45793a96-aee6-4279-afdf-c067cba35ee0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:10:02.471062 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-45793a96-aee6-4279-afdf-c067cba35ee0 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1732 microversion: 2.20 time: 0.217514 Aug 03 13:10:02.471617 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 514/1027] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:10:02 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1732 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:10:03.477006 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-590d04bb-776a-43c8-b9a9-5170a8593e19 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:10:03.477616 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-590d04bb-776a-43c8-b9a9-5170a8593e19 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:10:03.484620 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-590d04bb-776a-43c8-b9a9-5170a8593e19 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:03.485057 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-590d04bb-776a-43c8-b9a9-5170a8593e19 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:03.485803 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-590d04bb-776a-43c8-b9a9-5170a8593e19 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:03.486228 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-590d04bb-776a-43c8-b9a9-5170a8593e19 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:03.493197 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-b53ed034-fa6e-4d4a-9a12-657ee0496198 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:10:03.493805 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-b53ed034-fa6e-4d4a-9a12-657ee0496198 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:10:03.496351 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:03.501089 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b53ed034-fa6e-4d4a-9a12-657ee0496198 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:03.501534 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b53ed034-fa6e-4d4a-9a12-657ee0496198 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:03.502301 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b53ed034-fa6e-4d4a-9a12-657ee0496198 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:03.502767 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b53ed034-fa6e-4d4a-9a12-657ee0496198 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:03.684272 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-590d04bb-776a-43c8-b9a9-5170a8593e19 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:10:03.692010 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-590d04bb-776a-43c8-b9a9-5170a8593e19 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1260 microversion: 2.1 time: 0.218763 Aug 03 13:10:03.692587 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 514/1028] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:10:03 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1260 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:10:03.710939 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-b53ed034-fa6e-4d4a-9a12-657ee0496198 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:10:03.719679 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-b53ed034-fa6e-4d4a-9a12-657ee0496198 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:10:03.721197 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-b53ed034-fa6e-4d4a-9a12-657ee0496198 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:10:03.722357 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-b53ed034-fa6e-4d4a-9a12-657ee0496198 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1732 microversion: 2.20 time: 0.232978 Aug 03 13:10:03.722936 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 515/1029] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:10:03 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1732 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:10:04.712751 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-41765d85-f32e-4336-a8cb-e6639c732eab tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:10:04.713394 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-41765d85-f32e-4336-a8cb-e6639c732eab tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:10:04.720663 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-41765d85-f32e-4336-a8cb-e6639c732eab tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:04.721113 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-41765d85-f32e-4336-a8cb-e6639c732eab tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:04.721869 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-41765d85-f32e-4336-a8cb-e6639c732eab tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:04.722303 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-41765d85-f32e-4336-a8cb-e6639c732eab tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:04.745340 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d4e60883-7dfb-4dd9-b90c-8e19abb28bd6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:10:04.745943 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d4e60883-7dfb-4dd9-b90c-8e19abb28bd6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:10:04.752315 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d4e60883-7dfb-4dd9-b90c-8e19abb28bd6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:04.752826 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d4e60883-7dfb-4dd9-b90c-8e19abb28bd6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:04.753516 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d4e60883-7dfb-4dd9-b90c-8e19abb28bd6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:04.753941 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d4e60883-7dfb-4dd9-b90c-8e19abb28bd6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:04.927789 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-41765d85-f32e-4336-a8cb-e6639c732eab tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:10:04.930875 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d4e60883-7dfb-4dd9-b90c-8e19abb28bd6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:10:04.935771 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-41765d85-f32e-4336-a8cb-e6639c732eab tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1260 microversion: 2.1 time: 0.226851 Aug 03 13:10:04.936816 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 515/1030] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:10:04 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1260 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:10:04.939311 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d4e60883-7dfb-4dd9-b90c-8e19abb28bd6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:10:04.940812 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d4e60883-7dfb-4dd9-b90c-8e19abb28bd6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:10:04.941967 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d4e60883-7dfb-4dd9-b90c-8e19abb28bd6 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1732 microversion: 2.20 time: 0.200491 Aug 03 13:10:04.942533 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 516/1031] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:10:04 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1732 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:10:05.956984 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-1b774a03-1827-4c3e-992f-905d4fc26b11 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:10:05.957608 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-1b774a03-1827-4c3e-992f-905d4fc26b11 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:10:05.964198 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1b774a03-1827-4c3e-992f-905d4fc26b11 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:05.964643 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1b774a03-1827-4c3e-992f-905d4fc26b11 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:05.965247 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-573f8bc2-ef7d-41aa-b0f2-0aed2bdb0196 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:10:05.965650 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1b774a03-1827-4c3e-992f-905d4fc26b11 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:05.965828 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1b774a03-1827-4c3e-992f-905d4fc26b11 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:05.965936 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-573f8bc2-ef7d-41aa-b0f2-0aed2bdb0196 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:10:05.972499 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-573f8bc2-ef7d-41aa-b0f2-0aed2bdb0196 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:05.972947 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-573f8bc2-ef7d-41aa-b0f2-0aed2bdb0196 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:05.973749 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-573f8bc2-ef7d-41aa-b0f2-0aed2bdb0196 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:05.974185 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-573f8bc2-ef7d-41aa-b0f2-0aed2bdb0196 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:06.163464 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-1b774a03-1827-4c3e-992f-905d4fc26b11 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:10:06.168233 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-573f8bc2-ef7d-41aa-b0f2-0aed2bdb0196 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:10:06.171602 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-1b774a03-1827-4c3e-992f-905d4fc26b11 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1260 microversion: 2.1 time: 0.218636 Aug 03 13:10:06.172176 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 516/1032] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:10:05 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1260 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:10:06.176565 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-573f8bc2-ef7d-41aa-b0f2-0aed2bdb0196 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:10:06.178183 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-573f8bc2-ef7d-41aa-b0f2-0aed2bdb0196 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:10:06.179379 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-573f8bc2-ef7d-41aa-b0f2-0aed2bdb0196 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1719 microversion: 2.20 time: 0.217999 Aug 03 13:10:06.180166 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 517/1033] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:10:05 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1719 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:10:07.194898 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ba719f51-5661-452f-9555-341e935cd063 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:10:07.195551 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-ba719f51-5661-452f-9555-341e935cd063 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:10:07.202303 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ba719f51-5661-452f-9555-341e935cd063 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:07.202865 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ba719f51-5661-452f-9555-341e935cd063 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:07.203627 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ba719f51-5661-452f-9555-341e935cd063 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:07.204066 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ba719f51-5661-452f-9555-341e935cd063 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:07.333830 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ba719f51-5661-452f-9555-341e935cd063 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:10:07.341508 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-ba719f51-5661-452f-9555-341e935cd063 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1260 microversion: 2.1 time: 0.151659 Aug 03 13:10:07.342068 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 517/1034] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:10:07 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:10:08.363284 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-44f8ad28-e126-4717-9f51-8b9be043c4eb tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:10:08.363895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-44f8ad28-e126-4717-9f51-8b9be043c4eb tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:10:08.371041 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-44f8ad28-e126-4717-9f51-8b9be043c4eb tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:08.371491 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-44f8ad28-e126-4717-9f51-8b9be043c4eb tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:08.372251 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-44f8ad28-e126-4717-9f51-8b9be043c4eb tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:08.372684 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-44f8ad28-e126-4717-9f51-8b9be043c4eb tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:08.501160 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-44f8ad28-e126-4717-9f51-8b9be043c4eb tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:10:08.508530 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-44f8ad28-e126-4717-9f51-8b9be043c4eb tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1260 microversion: 2.1 time: 0.149158 Aug 03 13:10:08.509095 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 518/1035] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:10:08 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:10:09.354720 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-c43581f2-9a54-42db-8d8f-4123b8437190 req-948c8cd2-a58b-45c1-a364-70174427c5d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1370967-b0b8-4afe-99a9-142716f118bb", "name": "network-vif-plugged", "status": "completed", "tag": "12ced69b-7cb0-4bac-a7d5-0b77dc4d6f10"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:10:09.364643 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-c43581f2-9a54-42db-8d8f-4123b8437190 req-948c8cd2-a58b-45c1-a364-70174427c5d8 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:09.365076 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-c43581f2-9a54-42db-8d8f-4123b8437190 req-948c8cd2-a58b-45c1-a364-70174427c5d8 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:09.376399 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-c43581f2-9a54-42db-8d8f-4123b8437190 req-948c8cd2-a58b-45c1-a364-70174427c5d8 service nova] Creating event network-vif-plugged:12ced69b-7cb0-4bac-a7d5-0b77dc4d6f10 for instance b1370967-b0b8-4afe-99a9-142716f118bb on hv-cinder-85083 Aug 03 13:10:09.381532 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-c43581f2-9a54-42db-8d8f-4123b8437190 req-948c8cd2-a58b-45c1-a364-70174427c5d8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031038 Aug 03 13:10:09.382114 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 518/1036] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:10:09.530209 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-dbce542a-d2b4-4524-9843-22986ff5b71d tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:10:09.531229 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-dbce542a-d2b4-4524-9843-22986ff5b71d tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:10:09.538699 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-dbce542a-d2b4-4524-9843-22986ff5b71d tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:09.539192 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-dbce542a-d2b4-4524-9843-22986ff5b71d tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:09.539963 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-dbce542a-d2b4-4524-9843-22986ff5b71d tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:09.540401 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-dbce542a-d2b4-4524-9843-22986ff5b71d tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:09.675807 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-dbce542a-d2b4-4524-9843-22986ff5b71d tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:10:09.683874 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-dbce542a-d2b4-4524-9843-22986ff5b71d tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1260 microversion: 2.1 time: 0.158587 Aug 03 13:10:09.684453 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 519/1037] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:10:09 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:10:10.704339 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-4e321d82-3a48-495c-9ddd-374a82c8455a tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:10:10.705030 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-4e321d82-3a48-495c-9ddd-374a82c8455a tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:10:10.711719 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4e321d82-3a48-495c-9ddd-374a82c8455a tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:10.712166 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4e321d82-3a48-495c-9ddd-374a82c8455a tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:10.712911 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4e321d82-3a48-495c-9ddd-374a82c8455a tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:10.713343 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4e321d82-3a48-495c-9ddd-374a82c8455a tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:10.843438 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-4e321d82-3a48-495c-9ddd-374a82c8455a tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:10:10.850883 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-4e321d82-3a48-495c-9ddd-374a82c8455a tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1260 microversion: 2.1 time: 0.151066 Aug 03 13:10:10.851442 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 519/1038] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:10:10 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:10:11.871959 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-b3f22456-a3f7-463e-be8a-30d3da28d37c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:10:11.872568 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-b3f22456-a3f7-463e-be8a-30d3da28d37c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:10:11.879722 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b3f22456-a3f7-463e-be8a-30d3da28d37c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:11.880170 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b3f22456-a3f7-463e-be8a-30d3da28d37c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:11.881015 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b3f22456-a3f7-463e-be8a-30d3da28d37c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:11.881447 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-b3f22456-a3f7-463e-be8a-30d3da28d37c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:12.016401 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-b3f22456-a3f7-463e-be8a-30d3da28d37c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:10:12.023999 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-b3f22456-a3f7-463e-be8a-30d3da28d37c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1444 microversion: 2.1 time: 0.156497 Aug 03 13:10:12.024558 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 520/1039] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:10:11 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1444 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:10:12.045713 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-53841345-08c4-4c48-b80c-9ec8fe614d6e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:10:12.046377 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-53841345-08c4-4c48-b80c-9ec8fe614d6e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:10:12.053044 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-53841345-08c4-4c48-b80c-9ec8fe614d6e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:12.053501 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-53841345-08c4-4c48-b80c-9ec8fe614d6e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:12.054269 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-53841345-08c4-4c48-b80c-9ec8fe614d6e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:12.054706 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-53841345-08c4-4c48-b80c-9ec8fe614d6e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:12.181469 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-53841345-08c4-4c48-b80c-9ec8fe614d6e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:10:12.189597 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-53841345-08c4-4c48-b80c-9ec8fe614d6e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1444 microversion: 2.1 time: 0.147722 Aug 03 13:10:12.190162 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 520/1040] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:10:12 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1444 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:10:14.343663 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-b08cb57e-d3f9-419d-997d-2ac61d43aa2e req-bb53ae3a-8f16-428e-915f-e6d9c7019646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1370967-b0b8-4afe-99a9-142716f118bb", "tag": "12ced69b-7cb0-4bac-a7d5-0b77dc4d6f10"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:10:14.353629 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-b08cb57e-d3f9-419d-997d-2ac61d43aa2e req-bb53ae3a-8f16-428e-915f-e6d9c7019646 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:14.354569 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-b08cb57e-d3f9-419d-997d-2ac61d43aa2e req-bb53ae3a-8f16-428e-915f-e6d9c7019646 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:14.365848 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-b08cb57e-d3f9-419d-997d-2ac61d43aa2e req-bb53ae3a-8f16-428e-915f-e6d9c7019646 service nova] Creating event network-changed:12ced69b-7cb0-4bac-a7d5-0b77dc4d6f10 for instance b1370967-b0b8-4afe-99a9-142716f118bb on hv-cinder-85083 Aug 03 13:10:14.371820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-b08cb57e-d3f9-419d-997d-2ac61d43aa2e req-bb53ae3a-8f16-428e-915f-e6d9c7019646 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031852 Aug 03 13:10:14.376669 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 521/1041] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:10:49.364396 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=19 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:49.365073 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=95 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:49.494900 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-3c0ec250-71ca-4f70-bd21-ed0f970ad5d2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:10:49.495404 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-3c0ec250-71ca-4f70-bd21-ed0f970ad5d2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:10:49.502192 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3c0ec250-71ca-4f70-bd21-ed0f970ad5d2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:49.502640 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3c0ec250-71ca-4f70-bd21-ed0f970ad5d2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:49.503435 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3c0ec250-71ca-4f70-bd21-ed0f970ad5d2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:49.503871 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3c0ec250-71ca-4f70-bd21-ed0f970ad5d2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:49.526018 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-3c0ec250-71ca-4f70-bd21-ed0f970ad5d2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c/ips" status: 200 len: 149 microversion: 2.1 time: 0.166691 Aug 03 13:10:49.526562 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 521/1042] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Aug 3 13:10:49 2022] GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c/ips => generated 149 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:10:52.150871 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=13 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:52.152196 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=68 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:52.156571 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e7830558-bb1b-4bb1-9020-cf71f0ca53b6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27a26448-2172-4ca3-b567-141f8f2bf2dc"}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:10:52.166657 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-e7830558-bb1b-4bb1-9020-cf71f0ca53b6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:10:52.166657 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e7830558-bb1b-4bb1-9020-cf71f0ca53b6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:52.166657 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e7830558-bb1b-4bb1-9020-cf71f0ca53b6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:52.166657 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e7830558-bb1b-4bb1-9020-cf71f0ca53b6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:10:52.167562 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e7830558-bb1b-4bb1-9020-cf71f0ca53b6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:10:52.818699 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-e7830558-bb1b-4bb1-9020-cf71f0ca53b6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "POST /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.669290 Aug 03 13:10:52.819258 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 522/1043] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Aug 3 13:10:52 2022] POST /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c/os-volume_attachments => generated 194 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:11:00.429512 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ac46e790-f3a5-4084-a1fb-2bd2790e7cec tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:00.430073 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-ac46e790-f3a5-4084-a1fb-2bd2790e7cec tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:00.432566 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=2 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:00.433301 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=4 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:00.438107 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ac46e790-f3a5-4084-a1fb-2bd2790e7cec tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:00.438558 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ac46e790-f3a5-4084-a1fb-2bd2790e7cec tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:00.440042 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ac46e790-f3a5-4084-a1fb-2bd2790e7cec tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:00.440042 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ac46e790-f3a5-4084-a1fb-2bd2790e7cec tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:00.530351 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.objects.instance [None req-ac46e790-f3a5-4084-a1fb-2bd2790e7cec tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lazy-loading 'services' on Instance uuid 0acaf59b-bda1-4a84-aa4b-620a1a173e3c {{(pid=119409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:11:00.710975 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-ac46e790-f3a5-4084-a1fb-2bd2790e7cec tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c/os-volume_attachments/27a26448-2172-4ca3-b567-141f8f2bf2dc" status: 202 len: 0 microversion: 2.1 time: 0.285067 Aug 03 13:11:00.715084 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 522/1044] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Aug 3 13:11:00 2022] DELETE /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c/os-volume_attachments/27a26448-2172-4ca3-b567-141f8f2bf2dc => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 13:11:00.721875 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-295dda9b-87c1-426d-92c3-7259a226c8a3 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:00.724675 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-295dda9b-87c1-426d-92c3-7259a226c8a3 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:00.730971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-295dda9b-87c1-426d-92c3-7259a226c8a3 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:00.731457 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-295dda9b-87c1-426d-92c3-7259a226c8a3 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:00.732229 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-295dda9b-87c1-426d-92c3-7259a226c8a3 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:00.732697 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-295dda9b-87c1-426d-92c3-7259a226c8a3 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:00.762896 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-295dda9b-87c1-426d-92c3-7259a226c8a3 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046497 Aug 03 13:11:00.764075 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 523/1045] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 3 13:11:00 2022] GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:11:01.783418 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-a66ae14b-527b-451a-835b-103b7c64fbda tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:01.785963 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-a66ae14b-527b-451a-835b-103b7c64fbda tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:01.792214 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a66ae14b-527b-451a-835b-103b7c64fbda tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:01.792654 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a66ae14b-527b-451a-835b-103b7c64fbda tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:01.793399 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a66ae14b-527b-451a-835b-103b7c64fbda tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:01.793822 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a66ae14b-527b-451a-835b-103b7c64fbda tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:01.821958 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-a66ae14b-527b-451a-835b-103b7c64fbda tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043801 Aug 03 13:11:01.822489 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 523/1046] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 3 13:11:01 2022] GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:11:02.834332 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-2b257c00-210a-4191-beef-667eb01391c8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:02.836515 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-2b257c00-210a-4191-beef-667eb01391c8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:02.843235 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2b257c00-210a-4191-beef-667eb01391c8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:02.843686 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2b257c00-210a-4191-beef-667eb01391c8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:02.844451 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2b257c00-210a-4191-beef-667eb01391c8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:02.844891 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2b257c00-210a-4191-beef-667eb01391c8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:02.873619 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-2b257c00-210a-4191-beef-667eb01391c8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042645 Aug 03 13:11:02.874172 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 524/1047] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 3 13:11:02 2022] GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 13:11:02.934244 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-4f0c16bc-1318-4924-b8c5-4130e7215600 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:02.934806 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-4f0c16bc-1318-4924-b8c5-4130e7215600 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:02.941982 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4f0c16bc-1318-4924-b8c5-4130e7215600 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:02.942549 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4f0c16bc-1318-4924-b8c5-4130e7215600 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:02.943384 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4f0c16bc-1318-4924-b8c5-4130e7215600 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:02.943823 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4f0c16bc-1318-4924-b8c5-4130e7215600 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:02.969511 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-4f0c16bc-1318-4924-b8c5-4130e7215600 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] Going to try to terminate instance {{(pid=119409) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 13:11:03.243074 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-4f0c16bc-1318-4924-b8c5-4130e7215600 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c" status: 204 len: 0 microversion: 2.1 time: 0.312455 Aug 03 13:11:03.243766 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 524/1048] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 3 13:11:02 2022] DELETE /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 13:11:03.252099 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-7f16af60-5a2d-4bb6-935a-e125a727365e tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:03.252768 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-7f16af60-5a2d-4bb6-935a-e125a727365e tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:03.258796 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7f16af60-5a2d-4bb6-935a-e125a727365e tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:03.264373 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7f16af60-5a2d-4bb6-935a-e125a727365e tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:03.264373 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7f16af60-5a2d-4bb6-935a-e125a727365e tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:03.264373 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7f16af60-5a2d-4bb6-935a-e125a727365e tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:03.393063 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-7f16af60-5a2d-4bb6-935a-e125a727365e tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:03.400544 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-7f16af60-5a2d-4bb6-935a-e125a727365e tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c" status: 200 len: 1681 microversion: 2.1 time: 0.152389 Aug 03 13:11:03.401118 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 525/1049] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:03 2022] GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:04.423190 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-e8905e60-c4db-4ae9-b180-811737fbaed8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:04.423937 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-e8905e60-c4db-4ae9-b180-811737fbaed8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:04.430307 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e8905e60-c4db-4ae9-b180-811737fbaed8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:04.430774 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e8905e60-c4db-4ae9-b180-811737fbaed8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:04.431541 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e8905e60-c4db-4ae9-b180-811737fbaed8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:04.431958 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e8905e60-c4db-4ae9-b180-811737fbaed8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:04.564817 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-e8905e60-c4db-4ae9-b180-811737fbaed8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:04.572412 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-e8905e60-c4db-4ae9-b180-811737fbaed8 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c" status: 200 len: 1681 microversion: 2.1 time: 0.153479 Aug 03 13:11:04.573014 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 525/1050] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:04 2022] GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:05.594191 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-75ed80d2-b5d6-41bf-a5f1-135d6424b417 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:05.594875 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-75ed80d2-b5d6-41bf-a5f1-135d6424b417 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:05.601509 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-75ed80d2-b5d6-41bf-a5f1-135d6424b417 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:05.601959 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-75ed80d2-b5d6-41bf-a5f1-135d6424b417 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:05.602710 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-75ed80d2-b5d6-41bf-a5f1-135d6424b417 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:05.603161 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-75ed80d2-b5d6-41bf-a5f1-135d6424b417 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:05.742616 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-75ed80d2-b5d6-41bf-a5f1-135d6424b417 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:05.750121 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-75ed80d2-b5d6-41bf-a5f1-135d6424b417 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c" status: 200 len: 1681 microversion: 2.1 time: 0.160370 Aug 03 13:11:05.750692 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 526/1051] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:05 2022] GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:06.365001 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-3ee50d9c-c8a8-4633-8c8d-ff3cc72e2a6e req-7dacc1b6-2e13-4e2f-8a5c-af8664acf447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0acaf59b-bda1-4a84-aa4b-620a1a173e3c", "name": "network-vif-deleted", "tag": "74f6fb9f-3ac0-433e-8782-91aed42cb91e"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:11:06.374875 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-3ee50d9c-c8a8-4633-8c8d-ff3cc72e2a6e req-7dacc1b6-2e13-4e2f-8a5c-af8664acf447 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:06.375320 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-3ee50d9c-c8a8-4633-8c8d-ff3cc72e2a6e req-7dacc1b6-2e13-4e2f-8a5c-af8664acf447 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:06.386906 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-3ee50d9c-c8a8-4633-8c8d-ff3cc72e2a6e req-7dacc1b6-2e13-4e2f-8a5c-af8664acf447 service nova] Creating event network-vif-deleted:74f6fb9f-3ac0-433e-8782-91aed42cb91e for instance 0acaf59b-bda1-4a84-aa4b-620a1a173e3c on hv-cinder-85083 Aug 03 13:11:06.392636 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-3ee50d9c-c8a8-4633-8c8d-ff3cc72e2a6e req-7dacc1b6-2e13-4e2f-8a5c-af8664acf447 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088816 Aug 03 13:11:06.393829 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 526/1052] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:11:06.771758 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-950eff49-2971-4e76-85b3-437cc8470ea1 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:06.772512 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-950eff49-2971-4e76-85b3-437cc8470ea1 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:06.779122 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-950eff49-2971-4e76-85b3-437cc8470ea1 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:06.779642 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-950eff49-2971-4e76-85b3-437cc8470ea1 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:06.780469 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-950eff49-2971-4e76-85b3-437cc8470ea1 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:06.780903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-950eff49-2971-4e76-85b3-437cc8470ea1 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:06.817103 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-950eff49-2971-4e76-85b3-437cc8470ea1 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:06.817449 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-950eff49-2971-4e76-85b3-437cc8470ea1 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:06.817894 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-950eff49-2971-4e76-85b3-437cc8470ea1 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lazy-loading 'fault' on Instance uuid 0acaf59b-bda1-4a84-aa4b-620a1a173e3c {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:11:06.859826 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-950eff49-2971-4e76-85b3-437cc8470ea1 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36693fa42a7b41279c8d8c59ecafb243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cfcb8de5e448b8af185376a035263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:06.867843 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-950eff49-2971-4e76-85b3-437cc8470ea1 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c" status: 200 len: 1331 microversion: 2.1 time: 0.100038 Aug 03 13:11:06.868435 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 527/1053] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:06 2022] GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:07.891817 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-46553ee8-2ab7-459b-b10b-ba4175c89d57 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:07.892425 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-46553ee8-2ab7-459b-b10b-ba4175c89d57 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:07.898683 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-46553ee8-2ab7-459b-b10b-ba4175c89d57 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:07.899161 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-46553ee8-2ab7-459b-b10b-ba4175c89d57 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:07.899919 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-46553ee8-2ab7-459b-b10b-ba4175c89d57 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:07.900353 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-46553ee8-2ab7-459b-b10b-ba4175c89d57 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:07.914183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-46553ee8-2ab7-459b-b10b-ba4175c89d57 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] HTTP exception thrown: Instance 0acaf59b-bda1-4a84-aa4b-620a1a173e3c could not be found. Aug 03 13:11:07.915793 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-46553ee8-2ab7-459b-b10b-ba4175c89d57 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Request method failure captured: Aug 03 13:11:07.915793 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c HTTP/1.1 Aug 03 13:11:07.915793 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 13:11:07.915793 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 13:11:07.915793 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 13:11:07.915793 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 0 Aug 03 13:11:07.915793 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 13:11:07.915793 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 13:11:07.915793 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 13:11:07.915793 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 13:11:07.915793 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nE7DMH7_yawRG_EFqNprJ7tBLEAekyvd1TBnPLfkLY5FE_9FrSgGLljSycXdPTf3Im9G-ykq7spGFlIg47_VU_2Fobyvwk0dbllyHhXgHfuZGQytAsHHqjzEzu1SvE5rruA2LuPS1Zi7AyBd0EQ49IEVy0pbvx8Z15H7rrkhk-6aqQ Aug 03 13:11:07.915793 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 13:11:07.915793 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 13:11:07.915793 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 13:11:07.915793 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 13:11:07.915793 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 13:11:07.915793 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 13:11:07.915793 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: 23cfcb8de5e448b8af185376a035263b Aug 03 13:11:07.915793 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:11:07.915793 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 13:11:07.915793 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 13:11:07.917410 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_23cfcb8de5e448b8af185376a035263b", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:11:07.917410 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:11:07.917410 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: 23cfcb8de5e448b8af185376a035263b Aug 03 13:11:07.917410 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:11:07.917410 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-AttachVolumeNegativeTest-1034317644-project Aug 03 13:11:07.917410 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 13:11:07.917410 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 13:11:07.917410 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: 36693fa42a7b41279c8d8c59ecafb243 Aug 03 13:11:07.917410 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-AttachVolumeNegativeTest-1034317644-project Aug 03 13:11:07.917410 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: > Aug 03 13:11:07.917410 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Instance 0acaf59b-bda1-4a84-aa4b-620a1a173e3c could not be found. Aug 03 13:11:07.917410 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'id': '0acaf59b-bda1-4a84-aa4b-620a1a173e3c'} Aug 03 13:11:07.918265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:11:07.918265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:07.918265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:11:07.918265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:11:07.918265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:11:07.918265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:11:07.918265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:11:07.918265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:11:07.918265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:11:07.918265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:11:07.918265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0acaf59b-bda1-4a84-aa4b-620a1a173e3c could not be found. Aug 03 13:11:07.918265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:07.918265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:11:07.918265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:07.918265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:07.918265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:11:07.918265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:11:07.918265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:11:07.918265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:11:07.918265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:11:07.919791 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:11:07.919791 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:11:07.919791 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:11:07.919791 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:11:07.919791 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:11:07.919791 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:11:07.919791 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:11:07.919791 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0acaf59b-bda1-4a84-aa4b-620a1a173e3c could not be found. Aug 03 13:11:07.919791 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:07.919791 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:11:07.919791 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:07.919791 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:07.919791 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:11:07.919791 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:11:07.919791 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:11:07.919791 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:11:07.919791 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0acaf59b-bda1-4a84-aa4b-620a1a173e3c could not be found. Aug 03 13:11:07.919791 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:07.921183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-46553ee8-2ab7-459b-b10b-ba4175c89d57 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Returning 404 to user: Instance 0acaf59b-bda1-4a84-aa4b-620a1a173e3c could not be found. {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:11:07.921183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-46553ee8-2ab7-459b-b10b-ba4175c89d57 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c" status: 404 len: 111 microversion: 2.1 time: 0.030619 Aug 03 13:11:07.921183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 527/1054] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:07 2022] GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:11:07.925971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e4ea5f66-162c-4d27-96ad-4896a0374670 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '.version_select at 0x7fe6d808a940>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:08.003664 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-e4ea5f66-162c-4d27-96ad-4896a0374670 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-551060817" status: 202 len: 0 microversion: 2.1 time: 0.081384 Aug 03 13:11:08.004350 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 528/1055] 10.222.0.64 () {58 vars in 1218 bytes} [Wed Aug 3 13:11:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-551060817 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 13:11:11.941504 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-f1261a96-a4a9-43ac-9f0b-2c21cb6fc005 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:11.943884 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-f1261a96-a4a9-43ac-9f0b-2c21cb6fc005 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:11.950556 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f1261a96-a4a9-43ac-9f0b-2c21cb6fc005 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:11.951048 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f1261a96-a4a9-43ac-9f0b-2c21cb6fc005 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:11.952440 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f1261a96-a4a9-43ac-9f0b-2c21cb6fc005 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:11.952879 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f1261a96-a4a9-43ac-9f0b-2c21cb6fc005 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:11.981528 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-f1261a96-a4a9-43ac-9f0b-2c21cb6fc005 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044025 Aug 03 13:11:11.982064 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 528/1056] 10.222.0.64 () {60 vars in 1343 bytes} [Wed Aug 3 13:11:11 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:12.043386 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-4d3fed9f-fcf5-4d30-8705-5cf01c864961 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:12.043892 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-4d3fed9f-fcf5-4d30-8705-5cf01c864961 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:12.051029 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4d3fed9f-fcf5-4d30-8705-5cf01c864961 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:12.051476 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4d3fed9f-fcf5-4d30-8705-5cf01c864961 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:12.052268 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4d3fed9f-fcf5-4d30-8705-5cf01c864961 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:12.052703 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4d3fed9f-fcf5-4d30-8705-5cf01c864961 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:12.080672 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-4d3fed9f-fcf5-4d30-8705-5cf01c864961 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Going to try to terminate instance {{(pid=119410) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 13:11:12.402274 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-4d3fed9f-fcf5-4d30-8705-5cf01c864961 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "DELETE /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 204 len: 0 microversion: 2.20 time: 0.363031 Aug 03 13:11:12.402895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 529/1057] 10.222.0.64 () {60 vars in 1280 bytes} [Wed Aug 3 13:11:12 2022] DELETE /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 13:11:12.413529 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ab246187-a8e9-4de5-8647-f07edd036d24 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:12.414181 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-ab246187-a8e9-4de5-8647-f07edd036d24 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:12.420388 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ab246187-a8e9-4de5-8647-f07edd036d24 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:12.421461 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ab246187-a8e9-4de5-8647-f07edd036d24 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:12.422270 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ab246187-a8e9-4de5-8647-f07edd036d24 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:12.422706 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ab246187-a8e9-4de5-8647-f07edd036d24 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:12.552905 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ab246187-a8e9-4de5-8647-f07edd036d24 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:12.561377 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ab246187-a8e9-4de5-8647-f07edd036d24 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:12.562790 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ab246187-a8e9-4de5-8647-f07edd036d24 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:12.564003 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-ab246187-a8e9-4de5-8647-f07edd036d24 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1725 microversion: 2.20 time: 0.155811 Aug 03 13:11:12.564570 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 529/1058] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:11:12 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 13:11:13.151006 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-722c7cdc-b285-401e-9a95-66a588719914 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:13.151602 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-722c7cdc-b285-401e-9a95-66a588719914 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:13.158414 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-722c7cdc-b285-401e-9a95-66a588719914 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:13.158906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-722c7cdc-b285-401e-9a95-66a588719914 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:13.159790 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-722c7cdc-b285-401e-9a95-66a588719914 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:13.160234 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-722c7cdc-b285-401e-9a95-66a588719914 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:13.174122 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.wsgi [None req-722c7cdc-b285-401e-9a95-66a588719914 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] HTTP exception thrown: Instance 0acaf59b-bda1-4a84-aa4b-620a1a173e3c could not be found. Aug 03 13:11:13.175806 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-722c7cdc-b285-401e-9a95-66a588719914 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Request method failure captured: Aug 03 13:11:13.175806 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: request: DELETE /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c HTTP/1.1 Aug 03 13:11:13.175806 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept: application/json Aug 03 13:11:13.175806 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept-Encoding: identity Aug 03 13:11:13.175806 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Connection: close Aug 03 13:11:13.175806 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Length: 0 Aug 03 13:11:13.175806 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Type: application/json Aug 03 13:11:13.175806 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Host: 10.222.0.64 Aug 03 13:11:13.175806 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Openstack-System-Scope: None Aug 03 13:11:13.175806 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: User-Agent: python-urllib3/1.26.10 Aug 03 13:11:13.175806 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Auth-Token: gAAAAABi6nE7DMH7_yawRG_EFqNprJ7tBLEAekyvd1TBnPLfkLY5FE_9FrSgGLljSycXdPTf3Im9G-ykq7spGFlIg47_VU_2Fobyvwk0dbllyHhXgHfuZGQytAsHHqjzEzu1SvE5rruA2LuPS1Zi7AyBd0EQ49IEVy0pbvx8Z15H7rrkhk-6aqQ Aug 03 13:11:13.175806 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Id: None Aug 03 13:11:13.175806 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Name: None Aug 03 13:11:13.175806 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Identity-Status: Confirmed Aug 03 13:11:13.175806 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Is-Admin-Project: True Aug 03 13:11:13.175806 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Id: default Aug 03 13:11:13.175806 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Name: Default Aug 03 13:11:13.175806 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Id: 23cfcb8de5e448b8af185376a035263b Aug 03 13:11:13.175806 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Name: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:11:13.175806 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Role: member,reader Aug 03 13:11:13.175806 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Roles: member,reader Aug 03 13:11:13.177346 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_23cfcb8de5e448b8af185376a035263b", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:11:13.177346 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:11:13.177346 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Id: 23cfcb8de5e448b8af185376a035263b Aug 03 13:11:13.177346 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:11:13.177346 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User: tempest-AttachVolumeNegativeTest-1034317644-project Aug 03 13:11:13.177346 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Id: default Aug 03 13:11:13.177346 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Name: Default Aug 03 13:11:13.177346 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Id: 36693fa42a7b41279c8d8c59ecafb243 Aug 03 13:11:13.177346 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Name: tempest-AttachVolumeNegativeTest-1034317644-project Aug 03 13:11:13.177346 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: method: > Aug 03 13:11:13.177346 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: exception: Instance 0acaf59b-bda1-4a84-aa4b-620a1a173e3c could not be found. Aug 03 13:11:13.177346 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: action_args: {'id': '0acaf59b-bda1-4a84-aa4b-620a1a173e3c'} Aug 03 13:11:13.178276 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:11:13.178276 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:13.178276 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:11:13.178276 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:11:13.178276 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:11:13.178276 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:11:13.178276 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:11:13.178276 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:11:13.178276 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:11:13.178276 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:11:13.178276 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0acaf59b-bda1-4a84-aa4b-620a1a173e3c could not be found. Aug 03 13:11:13.178276 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:11:13.178276 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:11:13.178276 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:11:13.178276 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:13.178276 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:11:13.178276 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:11:13.178276 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:11:13.178276 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:11:13.178276 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:11:13.179649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:11:13.179649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 13:11:13.179649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 13:11:13.179649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 13:11:13.179649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 13:11:13.179649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:11:13.179649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:11:13.179649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:11:13.179649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:11:13.179649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0acaf59b-bda1-4a84-aa4b-620a1a173e3c could not be found. Aug 03 13:11:13.179649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:11:13.179649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:11:13.179649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:11:13.179649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:13.179649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:11:13.179649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:11:13.179649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:11:13.179649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:11:13.179649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0acaf59b-bda1-4a84-aa4b-620a1a173e3c could not be found. Aug 03 13:11:13.179649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:11:13.180934 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-722c7cdc-b285-401e-9a95-66a588719914 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Returning 404 to user: Instance 0acaf59b-bda1-4a84-aa4b-620a1a173e3c could not be found. {{(pid=119410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:11:13.180934 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-722c7cdc-b285-401e-9a95-66a588719914 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c" status: 404 len: 111 microversion: 2.1 time: 0.031150 Aug 03 13:11:13.180934 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 530/1059] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 3 13:11:13 2022] DELETE /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:11:13.185925 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-c3180dca-99f8-4603-a393-d0abff9840f6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:13.187072 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-c3180dca-99f8-4603-a393-d0abff9840f6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 0acaf59b-bda1-4a84-aa4b-620a1a173e3c] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:13.193578 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c3180dca-99f8-4603-a393-d0abff9840f6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:13.194024 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c3180dca-99f8-4603-a393-d0abff9840f6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:13.194844 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c3180dca-99f8-4603-a393-d0abff9840f6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:13.195279 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c3180dca-99f8-4603-a393-d0abff9840f6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:13.211021 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-c3180dca-99f8-4603-a393-d0abff9840f6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] HTTP exception thrown: Instance 0acaf59b-bda1-4a84-aa4b-620a1a173e3c could not be found. Aug 03 13:11:13.212507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-c3180dca-99f8-4603-a393-d0abff9840f6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Request method failure captured: Aug 03 13:11:13.212507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c HTTP/1.1 Aug 03 13:11:13.212507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 13:11:13.212507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 13:11:13.212507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 13:11:13.212507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 0 Aug 03 13:11:13.212507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 13:11:13.212507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 13:11:13.212507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 13:11:13.212507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 13:11:13.212507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nE7DMH7_yawRG_EFqNprJ7tBLEAekyvd1TBnPLfkLY5FE_9FrSgGLljSycXdPTf3Im9G-ykq7spGFlIg47_VU_2Fobyvwk0dbllyHhXgHfuZGQytAsHHqjzEzu1SvE5rruA2LuPS1Zi7AyBd0EQ49IEVy0pbvx8Z15H7rrkhk-6aqQ Aug 03 13:11:13.212507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 13:11:13.212507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 13:11:13.212507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 13:11:13.212507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 13:11:13.212507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 13:11:13.212507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 13:11:13.212507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: 23cfcb8de5e448b8af185376a035263b Aug 03 13:11:13.212507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:11:13.212507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 13:11:13.212507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 13:11:13.214068 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_23cfcb8de5e448b8af185376a035263b", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:11:13.214068 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:11:13.214068 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: 23cfcb8de5e448b8af185376a035263b Aug 03 13:11:13.214068 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:11:13.214068 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-AttachVolumeNegativeTest-1034317644-project Aug 03 13:11:13.214068 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 13:11:13.214068 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 13:11:13.214068 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: 36693fa42a7b41279c8d8c59ecafb243 Aug 03 13:11:13.214068 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-AttachVolumeNegativeTest-1034317644-project Aug 03 13:11:13.214068 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: > Aug 03 13:11:13.214068 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Instance 0acaf59b-bda1-4a84-aa4b-620a1a173e3c could not be found. Aug 03 13:11:13.214068 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'id': '0acaf59b-bda1-4a84-aa4b-620a1a173e3c'} Aug 03 13:11:13.215015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:11:13.215015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:13.215015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:11:13.215015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:11:13.215015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:11:13.215015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:11:13.215015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:11:13.215015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:11:13.215015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:11:13.215015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:11:13.215015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0acaf59b-bda1-4a84-aa4b-620a1a173e3c could not be found. Aug 03 13:11:13.215015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:13.215015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:11:13.215015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:13.215015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:13.215015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:11:13.215015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:11:13.215015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:11:13.215015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:11:13.215015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:11:13.216575 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:11:13.216575 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:11:13.216575 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:11:13.216575 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:11:13.216575 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:11:13.216575 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:11:13.216575 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:11:13.216575 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0acaf59b-bda1-4a84-aa4b-620a1a173e3c could not be found. Aug 03 13:11:13.216575 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:13.216575 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:11:13.216575 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:13.216575 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:13.216575 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:11:13.216575 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:11:13.216575 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:11:13.216575 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:11:13.216575 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0acaf59b-bda1-4a84-aa4b-620a1a173e3c could not be found. Aug 03 13:11:13.216575 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:13.217888 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-c3180dca-99f8-4603-a393-d0abff9840f6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Returning 404 to user: Instance 0acaf59b-bda1-4a84-aa4b-620a1a173e3c could not be found. {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:11:13.217888 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-c3180dca-99f8-4603-a393-d0abff9840f6 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c" status: 404 len: 111 microversion: 2.1 time: 0.031751 Aug 03 13:11:13.217888 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 530/1060] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:13 2022] GET /compute/v2.1/servers/0acaf59b-bda1-4a84-aa4b-620a1a173e3c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:11:13.586826 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-2cb2518d-cb60-4eea-a160-e7053451d208 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:13.587369 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-2cb2518d-cb60-4eea-a160-e7053451d208 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:13.593321 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2cb2518d-cb60-4eea-a160-e7053451d208 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:13.593773 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2cb2518d-cb60-4eea-a160-e7053451d208 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:13.594536 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2cb2518d-cb60-4eea-a160-e7053451d208 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:13.595005 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2cb2518d-cb60-4eea-a160-e7053451d208 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:13.725844 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-2cb2518d-cb60-4eea-a160-e7053451d208 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:13.734399 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-2cb2518d-cb60-4eea-a160-e7053451d208 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:13.735950 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-2cb2518d-cb60-4eea-a160-e7053451d208 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:13.737112 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-2cb2518d-cb60-4eea-a160-e7053451d208 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1725 microversion: 2.20 time: 0.154293 Aug 03 13:11:13.737673 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 531/1061] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:11:13 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:11:14.760676 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-9a28f36d-a04c-4ae9-a626-35b4e92e91cc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:14.761409 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-9a28f36d-a04c-4ae9-a626-35b4e92e91cc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:14.768441 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9a28f36d-a04c-4ae9-a626-35b4e92e91cc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:14.768889 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9a28f36d-a04c-4ae9-a626-35b4e92e91cc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:14.769661 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9a28f36d-a04c-4ae9-a626-35b4e92e91cc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:14.770092 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9a28f36d-a04c-4ae9-a626-35b4e92e91cc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:14.905066 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-9a28f36d-a04c-4ae9-a626-35b4e92e91cc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:14.913911 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-9a28f36d-a04c-4ae9-a626-35b4e92e91cc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:14.918910 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-9a28f36d-a04c-4ae9-a626-35b4e92e91cc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:14.918910 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-9a28f36d-a04c-4ae9-a626-35b4e92e91cc tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1725 microversion: 2.20 time: 0.159857 Aug 03 13:11:14.918910 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 531/1062] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:11:14 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:11:15.744154 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-306830a0-4724-404a-8af9-91cb1f8b81d4 req-91f57a1c-1209-439d-8b55-64e2f4128219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f0de60a-97c6-4897-a746-1c626065c1c7", "name": "network-vif-deleted", "tag": "9a26950b-91c5-47f5-a903-f189d725973f"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:11:15.754318 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-306830a0-4724-404a-8af9-91cb1f8b81d4 req-91f57a1c-1209-439d-8b55-64e2f4128219 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:15.754824 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-306830a0-4724-404a-8af9-91cb1f8b81d4 req-91f57a1c-1209-439d-8b55-64e2f4128219 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:15.766704 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-306830a0-4724-404a-8af9-91cb1f8b81d4 req-91f57a1c-1209-439d-8b55-64e2f4128219 service nova] Creating event network-vif-deleted:9a26950b-91c5-47f5-a903-f189d725973f for instance 9f0de60a-97c6-4897-a746-1c626065c1c7 on hv-cinder-85083 Aug 03 13:11:15.772339 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-306830a0-4724-404a-8af9-91cb1f8b81d4 req-91f57a1c-1209-439d-8b55-64e2f4128219 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032393 Aug 03 13:11:15.772944 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 532/1063] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:11:15.942564 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-43f5e5d2-be00-409f-a9d8-008a9a38dc02 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:15.944878 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-43f5e5d2-be00-409f-a9d8-008a9a38dc02 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:15.952774 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-43f5e5d2-be00-409f-a9d8-008a9a38dc02 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:15.953699 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-43f5e5d2-be00-409f-a9d8-008a9a38dc02 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:15.954723 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-43f5e5d2-be00-409f-a9d8-008a9a38dc02 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:15.955374 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-43f5e5d2-be00-409f-a9d8-008a9a38dc02 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:16.022889 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-43f5e5d2-be00-409f-a9d8-008a9a38dc02 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:16.031598 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-43f5e5d2-be00-409f-a9d8-008a9a38dc02 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:16.033171 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-43f5e5d2-be00-409f-a9d8-008a9a38dc02 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec4b53cb3a64c3aa9cb6a186a61c1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a420d95334148b68d78a6497e0d95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:16.034386 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-43f5e5d2-be00-409f-a9d8-008a9a38dc02 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 200 len: 1366 microversion: 2.20 time: 0.097486 Aug 03 13:11:16.035120 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 532/1064] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:11:15 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 1366 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 13:11:17.058175 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e2a0b170-8668-4e3a-bba9-95002b78bb30 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:17.058952 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-e2a0b170-8668-4e3a-bba9-95002b78bb30 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:17.066156 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e2a0b170-8668-4e3a-bba9-95002b78bb30 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:17.066614 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e2a0b170-8668-4e3a-bba9-95002b78bb30 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:17.067408 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e2a0b170-8668-4e3a-bba9-95002b78bb30 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:17.067847 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e2a0b170-8668-4e3a-bba9-95002b78bb30 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:17.081945 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.wsgi [None req-e2a0b170-8668-4e3a-bba9-95002b78bb30 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] HTTP exception thrown: Instance 9f0de60a-97c6-4897-a746-1c626065c1c7 could not be found. Aug 03 13:11:17.083629 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e2a0b170-8668-4e3a-bba9-95002b78bb30 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Request method failure captured: Aug 03 13:11:17.083629 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: request: GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 HTTP/1.1 Aug 03 13:11:17.083629 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept: application/json Aug 03 13:11:17.083629 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept-Encoding: identity Aug 03 13:11:17.083629 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Connection: close Aug 03 13:11:17.083629 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Length: 0 Aug 03 13:11:17.083629 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Type: application/json Aug 03 13:11:17.083629 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Host: 10.222.0.64 Aug 03 13:11:17.083629 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Openstack-System-Scope: None Aug 03 13:11:17.083629 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: User-Agent: python-urllib3/1.26.10 Aug 03 13:11:17.083629 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Auth-Token: gAAAAABi6nE71zelFFfGKJlRgXrGjLHThnj-8ig6uAcjJa1RghaqE1m9ZTUfUKiJ6hg9UPgcUYhQD3StQmEzsDREOR2sDhXhBK6adAd9GegMt7BWnzR-_iFaIhCl-0p46O7nDjI7-fUyDewdK7iYVDt2cQA8ka4JzKCKWEOPrGVkU9TokiY-SM8 Aug 03 13:11:17.083629 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Id: None Aug 03 13:11:17.083629 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Name: None Aug 03 13:11:17.083629 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Identity-Status: Confirmed Aug 03 13:11:17.083629 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Is-Admin-Project: True Aug 03 13:11:17.083629 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 13:11:17.083629 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Id: default Aug 03 13:11:17.083629 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Name: Default Aug 03 13:11:17.083629 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Id: 3a420d95334148b68d78a6497e0d95f5 Aug 03 13:11:17.083629 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-741141903 Aug 03 13:11:17.083629 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Role: member,reader Aug 03 13:11:17.083629 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Roles: member,reader Aug 03 13:11:17.086374 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3a420d95334148b68d78a6497e0d95f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a420d95334148b68d78a6497e0d95f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a420d95334148b68d78a6497e0d95f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3a420d95334148b68d78a6497e0d95f5", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:11:17.086374 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant: tempest-AttachVolumeShelveTestJSON-741141903 Aug 03 13:11:17.086374 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Id: 3a420d95334148b68d78a6497e0d95f5 Aug 03 13:11:17.086374 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-741141903 Aug 03 13:11:17.086374 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User: tempest-AttachVolumeShelveTestJSON-741141903-project Aug 03 13:11:17.086374 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Id: default Aug 03 13:11:17.086374 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Name: Default Aug 03 13:11:17.086374 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Id: 6ec4b53cb3a64c3aa9cb6a186a61c1fe Aug 03 13:11:17.086374 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Name: tempest-AttachVolumeShelveTestJSON-741141903-project Aug 03 13:11:17.086374 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: method: > Aug 03 13:11:17.086374 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: exception: Instance 9f0de60a-97c6-4897-a746-1c626065c1c7 could not be found. Aug 03 13:11:17.086374 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: action_args: {'id': '9f0de60a-97c6-4897-a746-1c626065c1c7'} Aug 03 13:11:17.087450 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:11:17.087450 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:17.087450 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:11:17.087450 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:11:17.087450 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:11:17.087450 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:11:17.087450 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:11:17.087450 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:11:17.087450 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:11:17.087450 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:11:17.087450 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f0de60a-97c6-4897-a746-1c626065c1c7 could not be found. Aug 03 13:11:17.087450 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:11:17.087450 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:11:17.087450 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:11:17.087450 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:17.087450 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:11:17.087450 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:11:17.087450 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:11:17.087450 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:11:17.087450 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:11:17.088892 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:11:17.088892 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:11:17.088892 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:11:17.088892 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:11:17.088892 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:11:17.088892 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:11:17.088892 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:11:17.088892 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f0de60a-97c6-4897-a746-1c626065c1c7 could not be found. Aug 03 13:11:17.088892 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:11:17.088892 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:11:17.088892 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:11:17.088892 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:17.088892 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:11:17.088892 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:11:17.088892 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:11:17.088892 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:11:17.088892 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f0de60a-97c6-4897-a746-1c626065c1c7 could not be found. Aug 03 13:11:17.088892 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:11:17.090225 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e2a0b170-8668-4e3a-bba9-95002b78bb30 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Returning 404 to user: Instance 9f0de60a-97c6-4897-a746-1c626065c1c7 could not be found. {{(pid=119410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:11:17.090225 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-e2a0b170-8668-4e3a-bba9-95002b78bb30 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 404 len: 111 microversion: 2.20 time: 0.031366 Aug 03 13:11:17.090225 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 533/1065] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:11:17 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 13:11:17.094026 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-fb20c9bc-6dc3-4cf3-9bca-9cdd6d6fb993 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '.version_select at 0x7fe6d80760d0>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:17.260711 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-fb20c9bc-6dc3-4cf3-9bca-9cdd6d6fb993 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-234391505" status: 204 len: 0 microversion: 2.20 time: 0.165421 Aug 03 13:11:17.260711 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 533/1066] 10.222.0.64 () {60 vars in 1259 bytes} [Wed Aug 3 13:11:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-234391505 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 13:11:17.661558 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1b25adf9-4923-4261-a789-a199f6f103b9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:17.662057 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-1b25adf9-4923-4261-a789-a199f6f103b9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:17.668050 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1b25adf9-4923-4261-a789-a199f6f103b9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:17.668501 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1b25adf9-4923-4261-a789-a199f6f103b9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:17.669743 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1b25adf9-4923-4261-a789-a199f6f103b9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:17.669743 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1b25adf9-4923-4261-a789-a199f6f103b9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:17.684321 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.wsgi [None req-1b25adf9-4923-4261-a789-a199f6f103b9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] HTTP exception thrown: Instance fdddc591-873f-484c-ac08-022cdfd864c1 could not be found. Aug 03 13:11:17.685861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1b25adf9-4923-4261-a789-a199f6f103b9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Request method failure captured: Aug 03 13:11:17.685861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: request: DELETE /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 HTTP/1.1 Aug 03 13:11:17.685861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept: application/json Aug 03 13:11:17.685861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept-Encoding: identity Aug 03 13:11:17.685861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Connection: close Aug 03 13:11:17.685861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Length: 0 Aug 03 13:11:17.685861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Type: application/json Aug 03 13:11:17.685861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Host: 10.222.0.64 Aug 03 13:11:17.685861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Openstack-System-Scope: None Aug 03 13:11:17.685861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: User-Agent: python-urllib3/1.26.10 Aug 03 13:11:17.685861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Auth-Token: gAAAAABi6nE7DMH7_yawRG_EFqNprJ7tBLEAekyvd1TBnPLfkLY5FE_9FrSgGLljSycXdPTf3Im9G-ykq7spGFlIg47_VU_2Fobyvwk0dbllyHhXgHfuZGQytAsHHqjzEzu1SvE5rruA2LuPS1Zi7AyBd0EQ49IEVy0pbvx8Z15H7rrkhk-6aqQ Aug 03 13:11:17.685861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Id: None Aug 03 13:11:17.685861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Name: None Aug 03 13:11:17.685861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Identity-Status: Confirmed Aug 03 13:11:17.685861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Is-Admin-Project: True Aug 03 13:11:17.685861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Id: default Aug 03 13:11:17.685861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Name: Default Aug 03 13:11:17.685861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Id: 23cfcb8de5e448b8af185376a035263b Aug 03 13:11:17.685861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Name: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:11:17.685861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Role: member,reader Aug 03 13:11:17.685861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Roles: member,reader Aug 03 13:11:17.687500 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_23cfcb8de5e448b8af185376a035263b", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:11:17.687500 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:11:17.687500 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Id: 23cfcb8de5e448b8af185376a035263b Aug 03 13:11:17.687500 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:11:17.687500 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User: tempest-AttachVolumeNegativeTest-1034317644-project Aug 03 13:11:17.687500 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Id: default Aug 03 13:11:17.687500 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Name: Default Aug 03 13:11:17.687500 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Id: 36693fa42a7b41279c8d8c59ecafb243 Aug 03 13:11:17.687500 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Name: tempest-AttachVolumeNegativeTest-1034317644-project Aug 03 13:11:17.687500 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: method: > Aug 03 13:11:17.687500 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: exception: Instance fdddc591-873f-484c-ac08-022cdfd864c1 could not be found. Aug 03 13:11:17.687500 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: action_args: {'id': 'fdddc591-873f-484c-ac08-022cdfd864c1'} Aug 03 13:11:17.688383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:11:17.688383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:17.688383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:11:17.688383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:11:17.688383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:11:17.688383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:11:17.688383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:11:17.688383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:11:17.688383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:11:17.688383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:11:17.688383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdddc591-873f-484c-ac08-022cdfd864c1 could not be found. Aug 03 13:11:17.688383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:11:17.688383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:11:17.688383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:11:17.688383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:17.688383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:11:17.688383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:11:17.688383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:11:17.688383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:11:17.688383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:11:17.689944 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:11:17.689944 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 13:11:17.689944 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 13:11:17.689944 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 13:11:17.689944 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 13:11:17.689944 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:11:17.689944 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:11:17.689944 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:11:17.689944 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:11:17.689944 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdddc591-873f-484c-ac08-022cdfd864c1 could not be found. Aug 03 13:11:17.689944 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:11:17.689944 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:11:17.689944 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:11:17.689944 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:17.689944 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:11:17.689944 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:11:17.689944 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:11:17.689944 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:11:17.689944 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdddc591-873f-484c-ac08-022cdfd864c1 could not be found. Aug 03 13:11:17.689944 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:11:17.691454 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1b25adf9-4923-4261-a789-a199f6f103b9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Returning 404 to user: Instance fdddc591-873f-484c-ac08-022cdfd864c1 could not be found. {{(pid=119410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:11:17.691454 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-1b25adf9-4923-4261-a789-a199f6f103b9 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "DELETE /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1" status: 404 len: 111 microversion: 2.1 time: 0.029809 Aug 03 13:11:17.691454 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 534/1067] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 3 13:11:17 2022] DELETE /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:11:17.696772 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-9a50e795-48e8-4ed0-9b2d-44f84ed2011b tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:17.697721 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-9a50e795-48e8-4ed0-9b2d-44f84ed2011b tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: fdddc591-873f-484c-ac08-022cdfd864c1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:17.704298 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9a50e795-48e8-4ed0-9b2d-44f84ed2011b tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:17.704748 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9a50e795-48e8-4ed0-9b2d-44f84ed2011b tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:17.705507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9a50e795-48e8-4ed0-9b2d-44f84ed2011b tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:17.705940 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9a50e795-48e8-4ed0-9b2d-44f84ed2011b tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:17.719568 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-9a50e795-48e8-4ed0-9b2d-44f84ed2011b tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] HTTP exception thrown: Instance fdddc591-873f-484c-ac08-022cdfd864c1 could not be found. Aug 03 13:11:17.721486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-9a50e795-48e8-4ed0-9b2d-44f84ed2011b tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Request method failure captured: Aug 03 13:11:17.721486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 HTTP/1.1 Aug 03 13:11:17.721486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 13:11:17.721486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 13:11:17.721486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 13:11:17.721486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 0 Aug 03 13:11:17.721486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 13:11:17.721486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 13:11:17.721486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 13:11:17.721486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 13:11:17.721486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nE7DMH7_yawRG_EFqNprJ7tBLEAekyvd1TBnPLfkLY5FE_9FrSgGLljSycXdPTf3Im9G-ykq7spGFlIg47_VU_2Fobyvwk0dbllyHhXgHfuZGQytAsHHqjzEzu1SvE5rruA2LuPS1Zi7AyBd0EQ49IEVy0pbvx8Z15H7rrkhk-6aqQ Aug 03 13:11:17.721486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 13:11:17.721486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 13:11:17.721486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 13:11:17.721486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 13:11:17.721486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 13:11:17.721486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 13:11:17.721486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: 23cfcb8de5e448b8af185376a035263b Aug 03 13:11:17.721486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:11:17.721486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 13:11:17.721486 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 13:11:17.723102 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_23cfcb8de5e448b8af185376a035263b", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:11:17.723102 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:11:17.723102 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: 23cfcb8de5e448b8af185376a035263b Aug 03 13:11:17.723102 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:11:17.723102 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-AttachVolumeNegativeTest-1034317644-project Aug 03 13:11:17.723102 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 13:11:17.723102 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 13:11:17.723102 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: 36693fa42a7b41279c8d8c59ecafb243 Aug 03 13:11:17.723102 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-AttachVolumeNegativeTest-1034317644-project Aug 03 13:11:17.723102 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: > Aug 03 13:11:17.723102 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Instance fdddc591-873f-484c-ac08-022cdfd864c1 could not be found. Aug 03 13:11:17.723102 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'id': 'fdddc591-873f-484c-ac08-022cdfd864c1'} Aug 03 13:11:17.724033 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:11:17.724033 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:17.724033 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:11:17.724033 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:11:17.724033 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:11:17.724033 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:11:17.724033 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:11:17.724033 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:11:17.724033 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:11:17.724033 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:11:17.724033 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdddc591-873f-484c-ac08-022cdfd864c1 could not be found. Aug 03 13:11:17.724033 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:17.724033 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:11:17.724033 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:17.724033 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:17.724033 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:11:17.724033 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:11:17.724033 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:11:17.724033 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:11:17.724033 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:11:17.725494 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:11:17.725494 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:11:17.725494 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:11:17.725494 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:11:17.725494 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:11:17.725494 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:11:17.725494 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:11:17.725494 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdddc591-873f-484c-ac08-022cdfd864c1 could not be found. Aug 03 13:11:17.725494 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:17.725494 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:11:17.725494 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:17.725494 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:17.725494 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:11:17.725494 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:11:17.725494 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:11:17.725494 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:11:17.725494 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdddc591-873f-484c-ac08-022cdfd864c1 could not be found. Aug 03 13:11:17.725494 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:17.727492 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-9a50e795-48e8-4ed0-9b2d-44f84ed2011b tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Returning 404 to user: Instance fdddc591-873f-484c-ac08-022cdfd864c1 could not be found. {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:11:17.727492 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-9a50e795-48e8-4ed0-9b2d-44f84ed2011b tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1" status: 404 len: 111 microversion: 2.1 time: 0.030017 Aug 03 13:11:17.727492 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 534/1068] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:17 2022] GET /compute/v2.1/servers/fdddc591-873f-484c-ac08-022cdfd864c1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:11:17.744109 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-381bc8d9-1b9c-4e87-afda-975e9c7a30ca tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:17.744569 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-381bc8d9-1b9c-4e87-afda-975e9c7a30ca tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 5079c8f3-b98d-4036-987d-fcac401752ed] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:17.750947 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-381bc8d9-1b9c-4e87-afda-975e9c7a30ca tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:17.751403 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-381bc8d9-1b9c-4e87-afda-975e9c7a30ca tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:17.752173 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-381bc8d9-1b9c-4e87-afda-975e9c7a30ca tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:17.752612 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-381bc8d9-1b9c-4e87-afda-975e9c7a30ca tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:17.767142 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.wsgi [None req-381bc8d9-1b9c-4e87-afda-975e9c7a30ca tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] HTTP exception thrown: Instance 5079c8f3-b98d-4036-987d-fcac401752ed could not be found. Aug 03 13:11:17.768673 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-381bc8d9-1b9c-4e87-afda-975e9c7a30ca tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Request method failure captured: Aug 03 13:11:17.768673 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: request: DELETE /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed HTTP/1.1 Aug 03 13:11:17.768673 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept: application/json Aug 03 13:11:17.768673 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept-Encoding: identity Aug 03 13:11:17.768673 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Connection: close Aug 03 13:11:17.768673 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Length: 0 Aug 03 13:11:17.768673 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Type: application/json Aug 03 13:11:17.768673 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Host: 10.222.0.64 Aug 03 13:11:17.768673 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Openstack-System-Scope: None Aug 03 13:11:17.768673 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: User-Agent: python-urllib3/1.26.10 Aug 03 13:11:17.768673 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Auth-Token: gAAAAABi6nE7DMH7_yawRG_EFqNprJ7tBLEAekyvd1TBnPLfkLY5FE_9FrSgGLljSycXdPTf3Im9G-ykq7spGFlIg47_VU_2Fobyvwk0dbllyHhXgHfuZGQytAsHHqjzEzu1SvE5rruA2LuPS1Zi7AyBd0EQ49IEVy0pbvx8Z15H7rrkhk-6aqQ Aug 03 13:11:17.768673 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Id: None Aug 03 13:11:17.768673 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Name: None Aug 03 13:11:17.768673 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Identity-Status: Confirmed Aug 03 13:11:17.768673 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Is-Admin-Project: True Aug 03 13:11:17.768673 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Id: default Aug 03 13:11:17.768673 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Name: Default Aug 03 13:11:17.768673 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Id: 23cfcb8de5e448b8af185376a035263b Aug 03 13:11:17.768673 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Name: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:11:17.768673 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Role: member,reader Aug 03 13:11:17.768673 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Roles: member,reader Aug 03 13:11:17.770271 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_23cfcb8de5e448b8af185376a035263b", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:11:17.770271 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:11:17.770271 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Id: 23cfcb8de5e448b8af185376a035263b Aug 03 13:11:17.770271 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:11:17.770271 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User: tempest-AttachVolumeNegativeTest-1034317644-project Aug 03 13:11:17.770271 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Id: default Aug 03 13:11:17.770271 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Name: Default Aug 03 13:11:17.770271 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Id: 36693fa42a7b41279c8d8c59ecafb243 Aug 03 13:11:17.770271 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Name: tempest-AttachVolumeNegativeTest-1034317644-project Aug 03 13:11:17.770271 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: method: > Aug 03 13:11:17.770271 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: exception: Instance 5079c8f3-b98d-4036-987d-fcac401752ed could not be found. Aug 03 13:11:17.770271 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: action_args: {'id': '5079c8f3-b98d-4036-987d-fcac401752ed'} Aug 03 13:11:17.771189 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:11:17.771189 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:17.771189 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:11:17.771189 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:11:17.771189 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:11:17.771189 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:11:17.771189 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:11:17.771189 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:11:17.771189 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:11:17.771189 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:11:17.771189 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5079c8f3-b98d-4036-987d-fcac401752ed could not be found. Aug 03 13:11:17.771189 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:11:17.771189 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:11:17.771189 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:11:17.771189 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:17.771189 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:11:17.771189 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:11:17.771189 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:11:17.771189 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:11:17.771189 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:11:17.772744 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:11:17.772744 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 13:11:17.772744 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 13:11:17.772744 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 13:11:17.772744 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 13:11:17.772744 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:11:17.772744 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:11:17.772744 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:11:17.772744 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:11:17.772744 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5079c8f3-b98d-4036-987d-fcac401752ed could not be found. Aug 03 13:11:17.772744 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:11:17.772744 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:11:17.772744 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:11:17.772744 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:17.772744 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:11:17.772744 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:11:17.772744 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:11:17.772744 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:11:17.772744 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5079c8f3-b98d-4036-987d-fcac401752ed could not be found. Aug 03 13:11:17.772744 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:11:17.774254 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-381bc8d9-1b9c-4e87-afda-975e9c7a30ca tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Returning 404 to user: Instance 5079c8f3-b98d-4036-987d-fcac401752ed could not be found. {{(pid=119410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:11:17.774254 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-381bc8d9-1b9c-4e87-afda-975e9c7a30ca tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "DELETE /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed" status: 404 len: 111 microversion: 2.1 time: 0.030235 Aug 03 13:11:17.774254 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 535/1069] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 3 13:11:17 2022] DELETE /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:11:17.780078 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ed52e702-a3b7-4476-b359-96b4366c8959 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:17.780699 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-ed52e702-a3b7-4476-b359-96b4366c8959 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 5079c8f3-b98d-4036-987d-fcac401752ed] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:17.786944 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ed52e702-a3b7-4476-b359-96b4366c8959 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:17.787395 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ed52e702-a3b7-4476-b359-96b4366c8959 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:17.788153 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ed52e702-a3b7-4476-b359-96b4366c8959 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:17.788597 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ed52e702-a3b7-4476-b359-96b4366c8959 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:17.802310 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-ed52e702-a3b7-4476-b359-96b4366c8959 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] HTTP exception thrown: Instance 5079c8f3-b98d-4036-987d-fcac401752ed could not be found. Aug 03 13:11:17.803875 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ed52e702-a3b7-4476-b359-96b4366c8959 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Request method failure captured: Aug 03 13:11:17.803875 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed HTTP/1.1 Aug 03 13:11:17.803875 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 13:11:17.803875 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 13:11:17.803875 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 13:11:17.803875 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 0 Aug 03 13:11:17.803875 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 13:11:17.803875 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 13:11:17.803875 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 13:11:17.803875 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 13:11:17.803875 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nE7DMH7_yawRG_EFqNprJ7tBLEAekyvd1TBnPLfkLY5FE_9FrSgGLljSycXdPTf3Im9G-ykq7spGFlIg47_VU_2Fobyvwk0dbllyHhXgHfuZGQytAsHHqjzEzu1SvE5rruA2LuPS1Zi7AyBd0EQ49IEVy0pbvx8Z15H7rrkhk-6aqQ Aug 03 13:11:17.803875 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 13:11:17.803875 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 13:11:17.803875 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 13:11:17.803875 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 13:11:17.803875 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 13:11:17.803875 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 13:11:17.803875 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: 23cfcb8de5e448b8af185376a035263b Aug 03 13:11:17.803875 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:11:17.803875 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 13:11:17.803875 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 13:11:17.805369 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_23cfcb8de5e448b8af185376a035263b", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:11:17.805369 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:11:17.805369 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: 23cfcb8de5e448b8af185376a035263b Aug 03 13:11:17.805369 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:11:17.805369 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-AttachVolumeNegativeTest-1034317644-project Aug 03 13:11:17.805369 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 13:11:17.805369 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 13:11:17.805369 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: 36693fa42a7b41279c8d8c59ecafb243 Aug 03 13:11:17.805369 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-AttachVolumeNegativeTest-1034317644-project Aug 03 13:11:17.805369 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: > Aug 03 13:11:17.805369 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Instance 5079c8f3-b98d-4036-987d-fcac401752ed could not be found. Aug 03 13:11:17.805369 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'id': '5079c8f3-b98d-4036-987d-fcac401752ed'} Aug 03 13:11:17.806485 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:11:17.806485 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:17.806485 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:11:17.806485 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:11:17.806485 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:11:17.806485 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:11:17.806485 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:11:17.806485 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:11:17.806485 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:11:17.806485 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:11:17.806485 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5079c8f3-b98d-4036-987d-fcac401752ed could not be found. Aug 03 13:11:17.806485 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:17.806485 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:11:17.806485 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:17.806485 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:17.806485 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:11:17.806485 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:11:17.806485 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:11:17.806485 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:11:17.806485 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:11:17.812675 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:11:17.812675 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:11:17.812675 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:11:17.812675 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:11:17.812675 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:11:17.812675 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:11:17.812675 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:11:17.812675 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5079c8f3-b98d-4036-987d-fcac401752ed could not be found. Aug 03 13:11:17.812675 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:17.812675 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:11:17.812675 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:17.812675 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:17.812675 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:11:17.812675 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:11:17.812675 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:11:17.812675 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:11:17.812675 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5079c8f3-b98d-4036-987d-fcac401752ed could not be found. Aug 03 13:11:17.812675 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:17.814290 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ed52e702-a3b7-4476-b359-96b4366c8959 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Returning 404 to user: Instance 5079c8f3-b98d-4036-987d-fcac401752ed could not be found. {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:11:17.814290 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-ed52e702-a3b7-4476-b359-96b4366c8959 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed" status: 404 len: 111 microversion: 2.1 time: 0.029510 Aug 03 13:11:17.814290 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 535/1070] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:17 2022] GET /compute/v2.1/servers/5079c8f3-b98d-4036-987d-fcac401752ed => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:11:19.718986 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-c95fab4e-d65c-4baf-bcab-63f29926b080 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-684711491", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-285932187", "security_groups": [{"name": "tempest-secgroup-smoke-1269265979"}], "block_device_mapping_v2": [{"uuid": "8b353cff-3343-467c-9e11-e721cfbb001d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "31f3d8b1-aaa3-4a1b-acac-10a82d58c4cb"}]}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:11:19.835529 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.network.neutron [None req-c95fab4e-d65c-4baf-bcab-63f29926b080 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] validate_networks() for [('31f3d8b1-aaa3-4a1b-acac-10a82d58c4cb', None, None, None, None, None)] {{(pid=119410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 13:11:20.187677 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d9c49ee8-32a2-4225-bd11-3eb0bd49c5e2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:20.188200 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-d9c49ee8-32a2-4225-bd11-3eb0bd49c5e2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:20.194218 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d9c49ee8-32a2-4225-bd11-3eb0bd49c5e2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:20.194664 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d9c49ee8-32a2-4225-bd11-3eb0bd49c5e2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:20.195451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d9c49ee8-32a2-4225-bd11-3eb0bd49c5e2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:20.195881 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d9c49ee8-32a2-4225-bd11-3eb0bd49c5e2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:20.209883 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-d9c49ee8-32a2-4225-bd11-3eb0bd49c5e2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] HTTP exception thrown: Instance 8097a062-4988-48d8-b95f-404fdf23d14a could not be found. Aug 03 13:11:20.211451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d9c49ee8-32a2-4225-bd11-3eb0bd49c5e2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Request method failure captured: Aug 03 13:11:20.211451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: DELETE /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a HTTP/1.1 Aug 03 13:11:20.211451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 13:11:20.211451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 13:11:20.211451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 13:11:20.211451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 0 Aug 03 13:11:20.211451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 13:11:20.211451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 13:11:20.211451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 13:11:20.211451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 13:11:20.211451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nE7DMH7_yawRG_EFqNprJ7tBLEAekyvd1TBnPLfkLY5FE_9FrSgGLljSycXdPTf3Im9G-ykq7spGFlIg47_VU_2Fobyvwk0dbllyHhXgHfuZGQytAsHHqjzEzu1SvE5rruA2LuPS1Zi7AyBd0EQ49IEVy0pbvx8Z15H7rrkhk-6aqQ Aug 03 13:11:20.211451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 13:11:20.211451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 13:11:20.211451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 13:11:20.211451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 13:11:20.211451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 13:11:20.211451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 13:11:20.211451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: 23cfcb8de5e448b8af185376a035263b Aug 03 13:11:20.211451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:11:20.211451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 13:11:20.211451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 13:11:20.213029 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_23cfcb8de5e448b8af185376a035263b", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:11:20.213029 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:11:20.213029 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: 23cfcb8de5e448b8af185376a035263b Aug 03 13:11:20.213029 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:11:20.213029 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-AttachVolumeNegativeTest-1034317644-project Aug 03 13:11:20.213029 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 13:11:20.213029 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 13:11:20.213029 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: 36693fa42a7b41279c8d8c59ecafb243 Aug 03 13:11:20.213029 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-AttachVolumeNegativeTest-1034317644-project Aug 03 13:11:20.213029 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: > Aug 03 13:11:20.213029 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Instance 8097a062-4988-48d8-b95f-404fdf23d14a could not be found. Aug 03 13:11:20.213029 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'id': '8097a062-4988-48d8-b95f-404fdf23d14a'} Aug 03 13:11:20.213923 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:11:20.213923 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:20.213923 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:11:20.213923 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:11:20.213923 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:11:20.213923 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:11:20.213923 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:11:20.213923 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:11:20.213923 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:11:20.213923 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:11:20.213923 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8097a062-4988-48d8-b95f-404fdf23d14a could not be found. Aug 03 13:11:20.213923 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:20.213923 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:11:20.213923 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:20.213923 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:20.213923 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:11:20.213923 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:11:20.213923 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:11:20.213923 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:11:20.213923 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:11:20.215826 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:11:20.215826 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 13:11:20.215826 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 13:11:20.215826 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 13:11:20.215826 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 13:11:20.215826 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:11:20.215826 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:11:20.215826 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:11:20.215826 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:11:20.215826 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8097a062-4988-48d8-b95f-404fdf23d14a could not be found. Aug 03 13:11:20.215826 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:20.215826 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:11:20.215826 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:20.215826 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:20.215826 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:11:20.215826 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:11:20.215826 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:11:20.215826 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:11:20.215826 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8097a062-4988-48d8-b95f-404fdf23d14a could not be found. Aug 03 13:11:20.215826 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:20.217114 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d9c49ee8-32a2-4225-bd11-3eb0bd49c5e2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Returning 404 to user: Instance 8097a062-4988-48d8-b95f-404fdf23d14a could not be found. {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:11:20.217114 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-d9c49ee8-32a2-4225-bd11-3eb0bd49c5e2 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "DELETE /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 404 len: 111 microversion: 2.1 time: 0.028999 Aug 03 13:11:20.217114 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 536/1071] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 3 13:11:20 2022] DELETE /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 13:11:20.223921 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-98b9c5f1-0bc7-4dcd-9265-d3756212dd63 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:20.224518 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-98b9c5f1-0bc7-4dcd-9265-d3756212dd63 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] [instance: 8097a062-4988-48d8-b95f-404fdf23d14a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:20.230507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-98b9c5f1-0bc7-4dcd-9265-d3756212dd63 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:20.230987 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-98b9c5f1-0bc7-4dcd-9265-d3756212dd63 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:20.231737 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-98b9c5f1-0bc7-4dcd-9265-d3756212dd63 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:20.232161 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-98b9c5f1-0bc7-4dcd-9265-d3756212dd63 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:20.245211 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-98b9c5f1-0bc7-4dcd-9265-d3756212dd63 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] HTTP exception thrown: Instance 8097a062-4988-48d8-b95f-404fdf23d14a could not be found. Aug 03 13:11:20.246724 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-98b9c5f1-0bc7-4dcd-9265-d3756212dd63 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Request method failure captured: Aug 03 13:11:20.246724 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a HTTP/1.1 Aug 03 13:11:20.246724 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 13:11:20.246724 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 13:11:20.246724 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 13:11:20.246724 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 0 Aug 03 13:11:20.246724 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 13:11:20.246724 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 13:11:20.246724 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 13:11:20.246724 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 13:11:20.246724 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nE7DMH7_yawRG_EFqNprJ7tBLEAekyvd1TBnPLfkLY5FE_9FrSgGLljSycXdPTf3Im9G-ykq7spGFlIg47_VU_2Fobyvwk0dbllyHhXgHfuZGQytAsHHqjzEzu1SvE5rruA2LuPS1Zi7AyBd0EQ49IEVy0pbvx8Z15H7rrkhk-6aqQ Aug 03 13:11:20.246724 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 13:11:20.246724 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 13:11:20.246724 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 13:11:20.246724 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 13:11:20.246724 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 13:11:20.246724 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 13:11:20.246724 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: 23cfcb8de5e448b8af185376a035263b Aug 03 13:11:20.246724 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:11:20.246724 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 13:11:20.246724 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 13:11:20.248095 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/23cfcb8de5e448b8af185376a035263b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_23cfcb8de5e448b8af185376a035263b", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:11:20.248095 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:11:20.248095 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: 23cfcb8de5e448b8af185376a035263b Aug 03 13:11:20.248095 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1034317644 Aug 03 13:11:20.248095 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-AttachVolumeNegativeTest-1034317644-project Aug 03 13:11:20.248095 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 13:11:20.248095 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 13:11:20.248095 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: 36693fa42a7b41279c8d8c59ecafb243 Aug 03 13:11:20.248095 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-AttachVolumeNegativeTest-1034317644-project Aug 03 13:11:20.248095 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: > Aug 03 13:11:20.248095 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Instance 8097a062-4988-48d8-b95f-404fdf23d14a could not be found. Aug 03 13:11:20.248095 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'id': '8097a062-4988-48d8-b95f-404fdf23d14a'} Aug 03 13:11:20.249058 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:11:20.249058 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:20.249058 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:11:20.249058 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:11:20.249058 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:11:20.249058 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:11:20.249058 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:11:20.249058 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:11:20.249058 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:11:20.249058 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:11:20.249058 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8097a062-4988-48d8-b95f-404fdf23d14a could not be found. Aug 03 13:11:20.249058 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:20.249058 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:11:20.249058 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:20.249058 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:20.249058 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:11:20.249058 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:11:20.249058 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:11:20.249058 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:11:20.249058 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:11:20.250422 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:11:20.250422 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:11:20.250422 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:11:20.250422 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:11:20.250422 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:11:20.250422 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:11:20.250422 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:11:20.250422 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8097a062-4988-48d8-b95f-404fdf23d14a could not be found. Aug 03 13:11:20.250422 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:20.250422 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:11:20.250422 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:20.250422 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:20.250422 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:11:20.250422 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:11:20.250422 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:11:20.250422 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:11:20.250422 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8097a062-4988-48d8-b95f-404fdf23d14a could not be found. Aug 03 13:11:20.250422 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:20.251611 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-98b9c5f1-0bc7-4dcd-9265-d3756212dd63 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] Returning 404 to user: Instance 8097a062-4988-48d8-b95f-404fdf23d14a could not be found. {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:11:20.251611 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-98b9c5f1-0bc7-4dcd-9265-d3756212dd63 tempest-AttachVolumeNegativeTest-1034317644 tempest-AttachVolumeNegativeTest-1034317644-project] 10.222.0.64 "GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a" status: 404 len: 111 microversion: 2.1 time: 0.027972 Aug 03 13:11:20.251611 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 537/1072] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:20 2022] GET /compute/v2.1/servers/8097a062-4988-48d8-b95f-404fdf23d14a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 13:11:20.264044 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-c95fab4e-d65c-4baf-bcab-63f29926b080 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Flavor limits 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 13:11:20.264537 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-c95fab4e-d65c-4baf-bcab-63f29926b080 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Image limits 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 13:11:20.265098 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-c95fab4e-d65c-4baf-bcab-63f29926b080 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Flavor pref 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 13:11:20.266180 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-c95fab4e-d65c-4baf-bcab-63f29926b080 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Image pref 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 13:11:20.266657 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-c95fab4e-d65c-4baf-bcab-63f29926b080 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 13:11:20.275808 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c95fab4e-d65c-4baf-bcab-63f29926b080 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:20.276411 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c95fab4e-d65c-4baf-bcab-63f29926b080 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:20.277279 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c95fab4e-d65c-4baf-bcab-63f29926b080 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:20.277841 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c95fab4e-d65c-4baf-bcab-63f29926b080 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:20.295350 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.quota [None req-c95fab4e-d65c-4baf-bcab-63f29926b080 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Getting quotas for project 5c182a81a1c64866944f21c4e26725a3. Resources: {'instances', 'ram', 'cores'} {{(pid=119410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 13:11:20.299364 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.quota [None req-c95fab4e-d65c-4baf-bcab-63f29926b080 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Getting quotas for user b2ccafac03aa420db7f76165f20b0d3b and project 5c182a81a1c64866944f21c4e26725a3. Resources: {'instances', 'ram', 'cores'} {{(pid=119410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 13:11:20.355983 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-c95fab4e-d65c-4baf-bcab-63f29926b080 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Going to run 1 instances... {{(pid=119410) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 13:11:20.358161 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-c95fab4e-d65c-4baf-bcab-63f29926b080 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: 7a05326d-b738-482a-a346-f9f196543ba2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8b353cff-3343-467c-9e11-e721cfbb001d',volume_size=None,volume_type=None)] {{(pid=119410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 13:11:20.392908 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-b42d7751-09bf-431c-8b26-93f7ef31b1de tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:20.393408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-b42d7751-09bf-431c-8b26-93f7ef31b1de tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:20.399869 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b42d7751-09bf-431c-8b26-93f7ef31b1de tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:20.400539 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b42d7751-09bf-431c-8b26-93f7ef31b1de tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:20.401484 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b42d7751-09bf-431c-8b26-93f7ef31b1de tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:20.401918 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b42d7751-09bf-431c-8b26-93f7ef31b1de tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:20.416223 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-b42d7751-09bf-431c-8b26-93f7ef31b1de tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] HTTP exception thrown: Instance 9f0de60a-97c6-4897-a746-1c626065c1c7 could not be found. Aug 03 13:11:20.417795 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-b42d7751-09bf-431c-8b26-93f7ef31b1de tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Request method failure captured: Aug 03 13:11:20.417795 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: DELETE /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 HTTP/1.1 Aug 03 13:11:20.417795 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 13:11:20.417795 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 13:11:20.417795 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 13:11:20.417795 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 0 Aug 03 13:11:20.417795 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 13:11:20.417795 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 13:11:20.417795 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 13:11:20.417795 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 13:11:20.417795 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nE71zelFFfGKJlRgXrGjLHThnj-8ig6uAcjJa1RghaqE1m9ZTUfUKiJ6hg9UPgcUYhQD3StQmEzsDREOR2sDhXhBK6adAd9GegMt7BWnzR-_iFaIhCl-0p46O7nDjI7-fUyDewdK7iYVDt2cQA8ka4JzKCKWEOPrGVkU9TokiY-SM8 Aug 03 13:11:20.417795 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 13:11:20.417795 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 13:11:20.417795 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 13:11:20.417795 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 13:11:20.417795 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 13:11:20.417795 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 13:11:20.417795 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 13:11:20.417795 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: 3a420d95334148b68d78a6497e0d95f5 Aug 03 13:11:20.417795 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-741141903 Aug 03 13:11:20.417795 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 13:11:20.417795 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 13:11:20.419563 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3a420d95334148b68d78a6497e0d95f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a420d95334148b68d78a6497e0d95f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a420d95334148b68d78a6497e0d95f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3a420d95334148b68d78a6497e0d95f5", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:11:20.419563 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-AttachVolumeShelveTestJSON-741141903 Aug 03 13:11:20.419563 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: 3a420d95334148b68d78a6497e0d95f5 Aug 03 13:11:20.419563 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-741141903 Aug 03 13:11:20.419563 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-AttachVolumeShelveTestJSON-741141903-project Aug 03 13:11:20.419563 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 13:11:20.419563 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 13:11:20.419563 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: 6ec4b53cb3a64c3aa9cb6a186a61c1fe Aug 03 13:11:20.419563 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-AttachVolumeShelveTestJSON-741141903-project Aug 03 13:11:20.419563 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: > Aug 03 13:11:20.419563 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Instance 9f0de60a-97c6-4897-a746-1c626065c1c7 could not be found. Aug 03 13:11:20.419563 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'id': '9f0de60a-97c6-4897-a746-1c626065c1c7'} Aug 03 13:11:20.420453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:11:20.420453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:20.420453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:11:20.420453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:11:20.420453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:11:20.420453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:11:20.420453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:11:20.420453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:11:20.420453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:11:20.420453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:11:20.420453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f0de60a-97c6-4897-a746-1c626065c1c7 could not be found. Aug 03 13:11:20.420453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:20.420453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:11:20.420453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:20.420453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:20.420453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:11:20.420453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:11:20.420453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:11:20.420453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:11:20.420453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:11:20.421996 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:11:20.421996 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 13:11:20.421996 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 13:11:20.421996 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 13:11:20.421996 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 13:11:20.421996 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:11:20.421996 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:11:20.421996 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:11:20.421996 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:11:20.421996 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f0de60a-97c6-4897-a746-1c626065c1c7 could not be found. Aug 03 13:11:20.421996 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:20.421996 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:11:20.421996 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:20.421996 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:20.421996 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:11:20.421996 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:11:20.421996 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:11:20.421996 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:11:20.421996 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f0de60a-97c6-4897-a746-1c626065c1c7 could not be found. Aug 03 13:11:20.421996 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:20.423510 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-b42d7751-09bf-431c-8b26-93f7ef31b1de tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Returning 404 to user: Instance 9f0de60a-97c6-4897-a746-1c626065c1c7 could not be found. {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:11:20.423510 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-b42d7751-09bf-431c-8b26-93f7ef31b1de tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "DELETE /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 404 len: 111 microversion: 2.20 time: 0.030855 Aug 03 13:11:20.423510 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 538/1073] 10.222.0.64 () {60 vars in 1280 bytes} [Wed Aug 3 13:11:20 2022] DELETE /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 03 13:11:20.427216 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d5401a9c-88ed-447d-9551-7efef9572e0c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:20.427817 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-d5401a9c-88ed-447d-9551-7efef9572e0c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 9f0de60a-97c6-4897-a746-1c626065c1c7] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:20.433722 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d5401a9c-88ed-447d-9551-7efef9572e0c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:20.434170 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d5401a9c-88ed-447d-9551-7efef9572e0c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:20.434991 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d5401a9c-88ed-447d-9551-7efef9572e0c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:20.435424 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d5401a9c-88ed-447d-9551-7efef9572e0c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:20.448655 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-d5401a9c-88ed-447d-9551-7efef9572e0c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] HTTP exception thrown: Instance 9f0de60a-97c6-4897-a746-1c626065c1c7 could not be found. Aug 03 13:11:20.450175 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d5401a9c-88ed-447d-9551-7efef9572e0c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Request method failure captured: Aug 03 13:11:20.450175 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 HTTP/1.1 Aug 03 13:11:20.450175 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 13:11:20.450175 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 13:11:20.450175 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 13:11:20.450175 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 0 Aug 03 13:11:20.450175 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 13:11:20.450175 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 13:11:20.450175 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 13:11:20.450175 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 13:11:20.450175 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nE71zelFFfGKJlRgXrGjLHThnj-8ig6uAcjJa1RghaqE1m9ZTUfUKiJ6hg9UPgcUYhQD3StQmEzsDREOR2sDhXhBK6adAd9GegMt7BWnzR-_iFaIhCl-0p46O7nDjI7-fUyDewdK7iYVDt2cQA8ka4JzKCKWEOPrGVkU9TokiY-SM8 Aug 03 13:11:20.450175 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 13:11:20.450175 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 13:11:20.450175 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 13:11:20.450175 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 13:11:20.450175 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 13:11:20.450175 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 13:11:20.450175 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 13:11:20.450175 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: 3a420d95334148b68d78a6497e0d95f5 Aug 03 13:11:20.450175 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-741141903 Aug 03 13:11:20.450175 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 13:11:20.450175 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 13:11:20.451716 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3a420d95334148b68d78a6497e0d95f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a420d95334148b68d78a6497e0d95f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a420d95334148b68d78a6497e0d95f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3a420d95334148b68d78a6497e0d95f5", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:11:20.451716 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-AttachVolumeShelveTestJSON-741141903 Aug 03 13:11:20.451716 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: 3a420d95334148b68d78a6497e0d95f5 Aug 03 13:11:20.451716 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-741141903 Aug 03 13:11:20.451716 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-AttachVolumeShelveTestJSON-741141903-project Aug 03 13:11:20.451716 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 13:11:20.451716 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 13:11:20.451716 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: 6ec4b53cb3a64c3aa9cb6a186a61c1fe Aug 03 13:11:20.451716 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-AttachVolumeShelveTestJSON-741141903-project Aug 03 13:11:20.451716 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: > Aug 03 13:11:20.451716 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Instance 9f0de60a-97c6-4897-a746-1c626065c1c7 could not be found. Aug 03 13:11:20.451716 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'id': '9f0de60a-97c6-4897-a746-1c626065c1c7'} Aug 03 13:11:20.452605 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:11:20.452605 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:20.452605 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:11:20.452605 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:11:20.452605 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:11:20.452605 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:11:20.452605 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:11:20.452605 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:11:20.452605 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:11:20.452605 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:11:20.452605 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f0de60a-97c6-4897-a746-1c626065c1c7 could not be found. Aug 03 13:11:20.452605 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:20.452605 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:11:20.452605 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:20.452605 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:20.452605 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:11:20.452605 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:11:20.452605 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:11:20.452605 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:11:20.452605 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:11:20.454881 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:11:20.454881 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:11:20.454881 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:11:20.454881 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:11:20.454881 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:11:20.454881 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:11:20.454881 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:11:20.454881 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f0de60a-97c6-4897-a746-1c626065c1c7 could not be found. Aug 03 13:11:20.454881 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:20.454881 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:11:20.454881 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:20.454881 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:20.454881 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:11:20.454881 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:11:20.454881 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:11:20.454881 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:11:20.454881 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f0de60a-97c6-4897-a746-1c626065c1c7 could not be found. Aug 03 13:11:20.454881 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:20.464498 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d5401a9c-88ed-447d-9551-7efef9572e0c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Returning 404 to user: Instance 9f0de60a-97c6-4897-a746-1c626065c1c7 could not be found. {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:11:20.464498 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-d5401a9c-88ed-447d-9551-7efef9572e0c tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7" status: 404 len: 111 microversion: 2.20 time: 0.027939 Aug 03 13:11:20.464498 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 539/1074] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:11:20 2022] GET /compute/v2.1/servers/9f0de60a-97c6-4897-a746-1c626065c1c7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 03 13:11:20.800430 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-c95fab4e-d65c-4baf-bcab-63f29926b080 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.085228 Aug 03 13:11:20.801245 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 536/1075] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 3 13:11:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 1087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 13:11:20.812815 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-906bf132-b55e-451c-be9a-d1a2fb7e7563 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:20.817121 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-906bf132-b55e-451c-be9a-d1a2fb7e7563 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: 7a05326d-b738-482a-a346-f9f196543ba2] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:20.875051 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-906bf132-b55e-451c-be9a-d1a2fb7e7563 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:20.881969 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-906bf132-b55e-451c-be9a-d1a2fb7e7563 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2" status: 200 len: 1093 microversion: 2.1 time: 0.073592 Aug 03 13:11:20.882532 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 540/1076] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:20 2022] GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2 => generated 1093 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:21.777976 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-2b34797e-1440-4296-9959-5ae2155dd533 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:21.778469 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-2b34797e-1440-4296-9959-5ae2155dd533 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:21.784585 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2b34797e-1440-4296-9959-5ae2155dd533 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:21.785025 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2b34797e-1440-4296-9959-5ae2155dd533 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:21.790480 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2b34797e-1440-4296-9959-5ae2155dd533 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:21.790480 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2b34797e-1440-4296-9959-5ae2155dd533 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:21.800713 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.wsgi [None req-2b34797e-1440-4296-9959-5ae2155dd533 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] HTTP exception thrown: Instance 67e92b94-74d5-4161-ab5d-80b10c84bfb1 could not be found. Aug 03 13:11:21.803255 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-2b34797e-1440-4296-9959-5ae2155dd533 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Request method failure captured: Aug 03 13:11:21.803255 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: request: DELETE /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 HTTP/1.1 Aug 03 13:11:21.803255 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept: application/json Aug 03 13:11:21.803255 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept-Encoding: identity Aug 03 13:11:21.803255 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Connection: close Aug 03 13:11:21.803255 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Length: 0 Aug 03 13:11:21.803255 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Type: application/json Aug 03 13:11:21.803255 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Host: 10.222.0.64 Aug 03 13:11:21.803255 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Openstack-System-Scope: None Aug 03 13:11:21.803255 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: User-Agent: python-urllib3/1.26.10 Aug 03 13:11:21.803255 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Auth-Token: gAAAAABi6nE71zelFFfGKJlRgXrGjLHThnj-8ig6uAcjJa1RghaqE1m9ZTUfUKiJ6hg9UPgcUYhQD3StQmEzsDREOR2sDhXhBK6adAd9GegMt7BWnzR-_iFaIhCl-0p46O7nDjI7-fUyDewdK7iYVDt2cQA8ka4JzKCKWEOPrGVkU9TokiY-SM8 Aug 03 13:11:21.803255 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Id: None Aug 03 13:11:21.803255 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Name: None Aug 03 13:11:21.803255 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Identity-Status: Confirmed Aug 03 13:11:21.803255 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Is-Admin-Project: True Aug 03 13:11:21.803255 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 13:11:21.803255 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Id: default Aug 03 13:11:21.803255 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Name: Default Aug 03 13:11:21.803255 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Id: 3a420d95334148b68d78a6497e0d95f5 Aug 03 13:11:21.803255 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-741141903 Aug 03 13:11:21.803255 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Role: member,reader Aug 03 13:11:21.803255 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Roles: member,reader Aug 03 13:11:21.805055 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3a420d95334148b68d78a6497e0d95f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a420d95334148b68d78a6497e0d95f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a420d95334148b68d78a6497e0d95f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3a420d95334148b68d78a6497e0d95f5", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:11:21.805055 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant: tempest-AttachVolumeShelveTestJSON-741141903 Aug 03 13:11:21.805055 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Id: 3a420d95334148b68d78a6497e0d95f5 Aug 03 13:11:21.805055 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-741141903 Aug 03 13:11:21.805055 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User: tempest-AttachVolumeShelveTestJSON-741141903-project Aug 03 13:11:21.805055 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Id: default Aug 03 13:11:21.805055 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Name: Default Aug 03 13:11:21.805055 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Id: 6ec4b53cb3a64c3aa9cb6a186a61c1fe Aug 03 13:11:21.805055 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Name: tempest-AttachVolumeShelveTestJSON-741141903-project Aug 03 13:11:21.805055 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: method: > Aug 03 13:11:21.805055 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: exception: Instance 67e92b94-74d5-4161-ab5d-80b10c84bfb1 could not be found. Aug 03 13:11:21.805055 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: action_args: {'id': '67e92b94-74d5-4161-ab5d-80b10c84bfb1'} Aug 03 13:11:21.806170 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:11:21.806170 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:21.806170 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:11:21.806170 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:11:21.806170 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:11:21.806170 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:11:21.806170 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:11:21.806170 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:11:21.806170 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:11:21.806170 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:11:21.806170 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67e92b94-74d5-4161-ab5d-80b10c84bfb1 could not be found. Aug 03 13:11:21.806170 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:11:21.806170 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:11:21.806170 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:11:21.806170 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:21.806170 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:11:21.806170 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:11:21.806170 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:11:21.806170 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:11:21.806170 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:11:21.807502 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:11:21.807502 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 13:11:21.807502 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 13:11:21.807502 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 13:11:21.807502 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 13:11:21.807502 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:11:21.807502 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:11:21.807502 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:11:21.807502 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:11:21.807502 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67e92b94-74d5-4161-ab5d-80b10c84bfb1 could not be found. Aug 03 13:11:21.807502 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:11:21.807502 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:11:21.807502 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:11:21.807502 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:21.807502 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:11:21.807502 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:11:21.807502 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:11:21.807502 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:11:21.807502 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67e92b94-74d5-4161-ab5d-80b10c84bfb1 could not be found. Aug 03 13:11:21.807502 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:11:21.808904 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-2b34797e-1440-4296-9959-5ae2155dd533 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Returning 404 to user: Instance 67e92b94-74d5-4161-ab5d-80b10c84bfb1 could not be found. {{(pid=119410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:11:21.808904 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-2b34797e-1440-4296-9959-5ae2155dd533 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "DELETE /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 404 len: 111 microversion: 2.20 time: 0.031573 Aug 03 13:11:21.808904 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 537/1077] 10.222.0.64 () {60 vars in 1280 bytes} [Wed Aug 3 13:11:21 2022] DELETE /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 13:11:21.814657 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ba358f3c-51fc-4fbe-81b2-0d7389c80913 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:21.815302 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-ba358f3c-51fc-4fbe-81b2-0d7389c80913 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] [instance: 67e92b94-74d5-4161-ab5d-80b10c84bfb1] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:21.836959 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ba358f3c-51fc-4fbe-81b2-0d7389c80913 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:21.837401 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ba358f3c-51fc-4fbe-81b2-0d7389c80913 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:21.838183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ba358f3c-51fc-4fbe-81b2-0d7389c80913 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:21.838657 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ba358f3c-51fc-4fbe-81b2-0d7389c80913 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:21.852439 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-ba358f3c-51fc-4fbe-81b2-0d7389c80913 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] HTTP exception thrown: Instance 67e92b94-74d5-4161-ab5d-80b10c84bfb1 could not be found. Aug 03 13:11:21.853983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ba358f3c-51fc-4fbe-81b2-0d7389c80913 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Request method failure captured: Aug 03 13:11:21.853983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 HTTP/1.1 Aug 03 13:11:21.853983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 13:11:21.853983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 13:11:21.853983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 13:11:21.853983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 0 Aug 03 13:11:21.853983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 13:11:21.853983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 13:11:21.853983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 13:11:21.853983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 13:11:21.853983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nE71zelFFfGKJlRgXrGjLHThnj-8ig6uAcjJa1RghaqE1m9ZTUfUKiJ6hg9UPgcUYhQD3StQmEzsDREOR2sDhXhBK6adAd9GegMt7BWnzR-_iFaIhCl-0p46O7nDjI7-fUyDewdK7iYVDt2cQA8ka4JzKCKWEOPrGVkU9TokiY-SM8 Aug 03 13:11:21.853983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 13:11:21.853983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 13:11:21.853983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 13:11:21.853983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 13:11:21.853983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 13:11:21.853983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 13:11:21.853983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 13:11:21.853983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: 3a420d95334148b68d78a6497e0d95f5 Aug 03 13:11:21.853983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-741141903 Aug 03 13:11:21.853983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 13:11:21.853983 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 13:11:21.855697 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3a420d95334148b68d78a6497e0d95f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a420d95334148b68d78a6497e0d95f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a420d95334148b68d78a6497e0d95f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3a420d95334148b68d78a6497e0d95f5", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:11:21.855697 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-AttachVolumeShelveTestJSON-741141903 Aug 03 13:11:21.855697 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: 3a420d95334148b68d78a6497e0d95f5 Aug 03 13:11:21.855697 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-741141903 Aug 03 13:11:21.855697 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-AttachVolumeShelveTestJSON-741141903-project Aug 03 13:11:21.855697 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 13:11:21.855697 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 13:11:21.855697 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: 6ec4b53cb3a64c3aa9cb6a186a61c1fe Aug 03 13:11:21.855697 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-AttachVolumeShelveTestJSON-741141903-project Aug 03 13:11:21.855697 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: > Aug 03 13:11:21.855697 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Instance 67e92b94-74d5-4161-ab5d-80b10c84bfb1 could not be found. Aug 03 13:11:21.855697 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'id': '67e92b94-74d5-4161-ab5d-80b10c84bfb1'} Aug 03 13:11:21.856866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:11:21.856866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:21.856866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:11:21.856866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:11:21.856866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:11:21.856866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:11:21.856866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:11:21.856866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:11:21.856866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:11:21.856866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:11:21.856866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67e92b94-74d5-4161-ab5d-80b10c84bfb1 could not be found. Aug 03 13:11:21.856866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:21.856866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:11:21.856866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:21.856866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:21.856866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:11:21.856866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:11:21.856866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:11:21.856866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:11:21.856866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:11:21.858329 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:11:21.858329 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:11:21.858329 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:11:21.858329 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:11:21.858329 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:11:21.858329 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:11:21.858329 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:11:21.858329 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67e92b94-74d5-4161-ab5d-80b10c84bfb1 could not be found. Aug 03 13:11:21.858329 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:21.858329 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:11:21.858329 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:21.858329 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:11:21.858329 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:11:21.858329 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:11:21.858329 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:11:21.858329 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:11:21.858329 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67e92b94-74d5-4161-ab5d-80b10c84bfb1 could not be found. Aug 03 13:11:21.858329 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:11:21.861277 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ba358f3c-51fc-4fbe-81b2-0d7389c80913 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] Returning 404 to user: Instance 67e92b94-74d5-4161-ab5d-80b10c84bfb1 could not be found. {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:11:21.861277 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-ba358f3c-51fc-4fbe-81b2-0d7389c80913 tempest-AttachVolumeShelveTestJSON-741141903 tempest-AttachVolumeShelveTestJSON-741141903-project] 10.222.0.64 "GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1" status: 404 len: 111 microversion: 2.20 time: 0.045261 Aug 03 13:11:21.861277 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 541/1078] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 3 13:11:21 2022] GET /compute/v2.1/servers/67e92b94-74d5-4161-ab5d-80b10c84bfb1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 13:11:21.904888 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-14257114-e828-4723-9c2d-a2045e35c940 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:21.905513 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-14257114-e828-4723-9c2d-a2045e35c940 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: 7a05326d-b738-482a-a346-f9f196543ba2] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:21.912626 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-14257114-e828-4723-9c2d-a2045e35c940 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:21.917017 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-14257114-e828-4723-9c2d-a2045e35c940 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:21.917017 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-14257114-e828-4723-9c2d-a2045e35c940 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:21.917017 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-14257114-e828-4723-9c2d-a2045e35c940 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:22.015792 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-14257114-e828-4723-9c2d-a2045e35c940 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:22.023665 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-14257114-e828-4723-9c2d-a2045e35c940 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2" status: 200 len: 1143 microversion: 2.1 time: 0.123859 Aug 03 13:11:22.024337 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 538/1079] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:21 2022] GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2 => generated 1143 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:23.045365 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-fad2556a-9ec2-47fa-9dfd-d19ef2f11055 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:23.045942 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-fad2556a-9ec2-47fa-9dfd-d19ef2f11055 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: 7a05326d-b738-482a-a346-f9f196543ba2] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:23.053244 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fad2556a-9ec2-47fa-9dfd-d19ef2f11055 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:23.053708 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fad2556a-9ec2-47fa-9dfd-d19ef2f11055 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:23.054656 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fad2556a-9ec2-47fa-9dfd-d19ef2f11055 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:23.055113 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fad2556a-9ec2-47fa-9dfd-d19ef2f11055 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:23.132988 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-fad2556a-9ec2-47fa-9dfd-d19ef2f11055 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:23.140902 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-fad2556a-9ec2-47fa-9dfd-d19ef2f11055 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2" status: 200 len: 1199 microversion: 2.1 time: 0.099693 Aug 03 13:11:23.141700 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 542/1080] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:23 2022] GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2 => generated 1199 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:24.168759 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-a43e7441-178b-4b18-b5f0-024ecb20c964 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:24.170962 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-a43e7441-178b-4b18-b5f0-024ecb20c964 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: 7a05326d-b738-482a-a346-f9f196543ba2] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:24.181284 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:24.182959 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a43e7441-178b-4b18-b5f0-024ecb20c964 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:24.183408 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a43e7441-178b-4b18-b5f0-024ecb20c964 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:24.184292 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a43e7441-178b-4b18-b5f0-024ecb20c964 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:24.184723 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-a43e7441-178b-4b18-b5f0-024ecb20c964 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:24.189258 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:24.282006 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-a43e7441-178b-4b18-b5f0-024ecb20c964 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:24.296803 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-a43e7441-178b-4b18-b5f0-024ecb20c964 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2" status: 200 len: 1209 microversion: 2.1 time: 0.134223 Aug 03 13:11:24.297394 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 539/1081] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:24 2022] GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2 => generated 1209 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:25.325016 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-e7b844a3-a48e-4d6f-84d5-45e7fab934ac tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:25.326939 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-e7b844a3-a48e-4d6f-84d5-45e7fab934ac tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: 7a05326d-b738-482a-a346-f9f196543ba2] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:25.345452 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e7b844a3-a48e-4d6f-84d5-45e7fab934ac tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:25.346781 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e7b844a3-a48e-4d6f-84d5-45e7fab934ac tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:25.351344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e7b844a3-a48e-4d6f-84d5-45e7fab934ac tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:25.351344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e7b844a3-a48e-4d6f-84d5-45e7fab934ac tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:25.676364 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-e7b844a3-a48e-4d6f-84d5-45e7fab934ac tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:25.685153 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-e7b844a3-a48e-4d6f-84d5-45e7fab934ac tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2" status: 200 len: 1265 microversion: 2.1 time: 0.366028 Aug 03 13:11:25.687910 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 543/1082] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:25 2022] GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2 => generated 1265 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:25.840114 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-3d59c64f-4f0e-450c-8858-9eeedba42744 req-09d15ae2-14c2-440c-95ab-7b68af90eee7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a05326d-b738-482a-a346-f9f196543ba2", "tag": "a19852f9-3014-490d-ad00-cb10542b8236"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:11:25.851672 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-3d59c64f-4f0e-450c-8858-9eeedba42744 req-09d15ae2-14c2-440c-95ab-7b68af90eee7 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:25.852394 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-3d59c64f-4f0e-450c-8858-9eeedba42744 req-09d15ae2-14c2-440c-95ab-7b68af90eee7 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:25.863418 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-3d59c64f-4f0e-450c-8858-9eeedba42744 req-09d15ae2-14c2-440c-95ab-7b68af90eee7 service nova] Creating event network-changed:a19852f9-3014-490d-ad00-cb10542b8236 for instance 7a05326d-b738-482a-a346-f9f196543ba2 on hv-cinder-85083 Aug 03 13:11:25.868419 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-3d59c64f-4f0e-450c-8858-9eeedba42744 req-09d15ae2-14c2-440c-95ab-7b68af90eee7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034524 Aug 03 13:11:25.869052 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 540/1083] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:11:26.707590 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-eafb94da-927f-44d8-b463-fd292b8f0def tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:26.719165 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-eafb94da-927f-44d8-b463-fd292b8f0def tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: 7a05326d-b738-482a-a346-f9f196543ba2] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:26.730709 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-eafb94da-927f-44d8-b463-fd292b8f0def tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:26.731199 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-eafb94da-927f-44d8-b463-fd292b8f0def tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:26.732028 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-eafb94da-927f-44d8-b463-fd292b8f0def tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:26.732664 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-eafb94da-927f-44d8-b463-fd292b8f0def tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:26.982531 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-eafb94da-927f-44d8-b463-fd292b8f0def tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:26.990091 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:26.993476 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-eafb94da-927f-44d8-b463-fd292b8f0def tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2" status: 200 len: 1265 microversion: 2.1 time: 0.291199 Aug 03 13:11:27.006261 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 544/1084] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:26 2022] GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2 => generated 1265 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:28.019177 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-5ae30024-af13-4b09-a51a-9bc515474d95 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:28.020022 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-5ae30024-af13-4b09-a51a-9bc515474d95 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: 7a05326d-b738-482a-a346-f9f196543ba2] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:28.027701 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5ae30024-af13-4b09-a51a-9bc515474d95 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:28.028421 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5ae30024-af13-4b09-a51a-9bc515474d95 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:28.029548 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5ae30024-af13-4b09-a51a-9bc515474d95 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:28.030199 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5ae30024-af13-4b09-a51a-9bc515474d95 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:28.172061 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-5ae30024-af13-4b09-a51a-9bc515474d95 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:28.180527 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-5ae30024-af13-4b09-a51a-9bc515474d95 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2" status: 200 len: 1265 microversion: 2.1 time: 0.166730 Aug 03 13:11:28.181197 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 541/1085] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:28 2022] GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:29.201675 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-bcafa6ad-8645-4c8e-a8f0-078d92ef4e5b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:29.202319 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-bcafa6ad-8645-4c8e-a8f0-078d92ef4e5b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: 7a05326d-b738-482a-a346-f9f196543ba2] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:29.209931 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bcafa6ad-8645-4c8e-a8f0-078d92ef4e5b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:29.212420 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bcafa6ad-8645-4c8e-a8f0-078d92ef4e5b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:29.212420 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bcafa6ad-8645-4c8e-a8f0-078d92ef4e5b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:29.212420 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bcafa6ad-8645-4c8e-a8f0-078d92ef4e5b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:29.353961 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-bcafa6ad-8645-4c8e-a8f0-078d92ef4e5b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:29.355597 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-bcafa6ad-8645-4c8e-a8f0-078d92ef4e5b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2" status: 200 len: 1265 microversion: 2.1 time: 0.158179 Aug 03 13:11:29.356159 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 545/1086] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:29 2022] GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:30.376641 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-20f7f5a2-9fba-48a9-a661-b994381fd593 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:30.377252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-20f7f5a2-9fba-48a9-a661-b994381fd593 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: 7a05326d-b738-482a-a346-f9f196543ba2] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:30.380352 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=2 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:30.381085 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=6 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:30.387167 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-20f7f5a2-9fba-48a9-a661-b994381fd593 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:30.387623 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-20f7f5a2-9fba-48a9-a661-b994381fd593 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:30.388390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-20f7f5a2-9fba-48a9-a661-b994381fd593 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:30.388983 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-20f7f5a2-9fba-48a9-a661-b994381fd593 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:30.530917 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-20f7f5a2-9fba-48a9-a661-b994381fd593 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:30.539581 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-20f7f5a2-9fba-48a9-a661-b994381fd593 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2" status: 200 len: 1265 microversion: 2.1 time: 0.167614 Aug 03 13:11:30.540172 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 542/1087] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:30 2022] GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:31.562507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-1dbfa197-b641-4976-a8b6-df6aa2d36c2e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:31.563784 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-1dbfa197-b641-4976-a8b6-df6aa2d36c2e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: 7a05326d-b738-482a-a346-f9f196543ba2] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:31.567233 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell0:SELECT=2 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:31.571480 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:31.572828 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1dbfa197-b641-4976-a8b6-df6aa2d36c2e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:31.573269 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1dbfa197-b641-4976-a8b6-df6aa2d36c2e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:31.574203 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1dbfa197-b641-4976-a8b6-df6aa2d36c2e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:31.574810 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1dbfa197-b641-4976-a8b6-df6aa2d36c2e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:32.028236 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-1dbfa197-b641-4976-a8b6-df6aa2d36c2e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:32.037769 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-1dbfa197-b641-4976-a8b6-df6aa2d36c2e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2" status: 200 len: 1265 microversion: 2.1 time: 0.480051 Aug 03 13:11:32.038556 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 546/1088] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:31 2022] GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2 => generated 1265 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:33.065045 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e57c87cc-10dd-4a87-9f54-49ad96ceebc7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:33.065667 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-e57c87cc-10dd-4a87-9f54-49ad96ceebc7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: 7a05326d-b738-482a-a346-f9f196543ba2] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:33.072546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e57c87cc-10dd-4a87-9f54-49ad96ceebc7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:33.073239 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e57c87cc-10dd-4a87-9f54-49ad96ceebc7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:33.074390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e57c87cc-10dd-4a87-9f54-49ad96ceebc7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:33.075020 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e57c87cc-10dd-4a87-9f54-49ad96ceebc7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:33.334872 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-e57c87cc-10dd-4a87-9f54-49ad96ceebc7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:33.346719 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-e57c87cc-10dd-4a87-9f54-49ad96ceebc7 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2" status: 200 len: 1265 microversion: 2.1 time: 0.287761 Aug 03 13:11:33.347857 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 543/1089] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:33 2022] GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2 => generated 1265 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:34.367493 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d980480b-4dd6-47d7-8256-5ed71ceebd2b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:34.368104 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-d980480b-4dd6-47d7-8256-5ed71ceebd2b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: 7a05326d-b738-482a-a346-f9f196543ba2] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:34.383208 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d980480b-4dd6-47d7-8256-5ed71ceebd2b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:34.383650 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d980480b-4dd6-47d7-8256-5ed71ceebd2b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:34.384632 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d980480b-4dd6-47d7-8256-5ed71ceebd2b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:34.385224 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d980480b-4dd6-47d7-8256-5ed71ceebd2b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:34.554069 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-d980480b-4dd6-47d7-8256-5ed71ceebd2b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:34.563205 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-d980480b-4dd6-47d7-8256-5ed71ceebd2b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2" status: 200 len: 1265 microversion: 2.1 time: 0.199398 Aug 03 13:11:34.575270 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 547/1090] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:34 2022] GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2 => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:35.507185 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-4b7a7204-2af0-40c1-a42d-61231f587ecd tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Action: 'create', calling method: .version_select at 0x7fe6da9fa040>, body: {"keypair": {"name": "tempest-keypair-2143444063", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSMMPXIt286bcjMFXReHAeu/DkT4f+pO3V6y/ScImBaVAiSMX2mnM2ECmnkJFNUqM6eQxoRa5/5xg7OE8HQ/KaDMdD4uQt9/a7FRGb+3YncQCtDuwbkG18vt/96AQQ4XQ=="}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:11:35.523457 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.quota [None req-4b7a7204-2af0-40c1-a42d-61231f587ecd tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Getting quotas for project 965502bfffde4ee19c6bd7ea81f08672. Resources: {'key_pairs'} {{(pid=119410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 13:11:35.527737 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.quota [None req-4b7a7204-2af0-40c1-a42d-61231f587ecd tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Getting quotas for user 90109591e9cd43b9aab0fe5b1593e9dd and project 965502bfffde4ee19c6bd7ea81f08672. Resources: {'key_pairs'} {{(pid=119410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 13:11:35.586633 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-6ebb1a3b-32cf-424e-a26f-6660ee55a68b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:35.587269 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-6ebb1a3b-32cf-424e-a26f-6660ee55a68b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: 7a05326d-b738-482a-a346-f9f196543ba2] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:35.594173 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6ebb1a3b-32cf-424e-a26f-6660ee55a68b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:35.594605 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6ebb1a3b-32cf-424e-a26f-6660ee55a68b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:35.595396 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6ebb1a3b-32cf-424e-a26f-6660ee55a68b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:35.595838 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6ebb1a3b-32cf-424e-a26f-6660ee55a68b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:35.634097 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-4b7a7204-2af0-40c1-a42d-61231f587ecd tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.420847 Aug 03 13:11:35.635686 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 544/1091] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Aug 3 13:11:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:11:35.737086 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-6ebb1a3b-32cf-424e-a26f-6660ee55a68b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:35.745191 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-6ebb1a3b-32cf-424e-a26f-6660ee55a68b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2" status: 200 len: 1265 microversion: 2.1 time: 0.165470 Aug 03 13:11:35.745905 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 548/1092] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:35 2022] GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:11:36.767459 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-37de094b-72f4-4756-bfec-b1bf3f31597e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:36.769053 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-37de094b-72f4-4756-bfec-b1bf3f31597e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: 7a05326d-b738-482a-a346-f9f196543ba2] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:36.786770 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-37de094b-72f4-4756-bfec-b1bf3f31597e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:36.787657 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-37de094b-72f4-4756-bfec-b1bf3f31597e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:36.790498 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-37de094b-72f4-4756-bfec-b1bf3f31597e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:36.791178 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-37de094b-72f4-4756-bfec-b1bf3f31597e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:36.961472 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-37de094b-72f4-4756-bfec-b1bf3f31597e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:36.970921 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-37de094b-72f4-4756-bfec-b1bf3f31597e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2" status: 200 len: 1265 microversion: 2.1 time: 0.208900 Aug 03 13:11:36.984617 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 545/1093] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:36 2022] GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2 => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:37.998489 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-1c85b357-d03e-4cd6-b031-7000664b76d4 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:38.000192 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-1c85b357-d03e-4cd6-b031-7000664b76d4 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: 7a05326d-b738-482a-a346-f9f196543ba2] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:38.007268 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1c85b357-d03e-4cd6-b031-7000664b76d4 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:38.007723 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1c85b357-d03e-4cd6-b031-7000664b76d4 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:38.008543 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1c85b357-d03e-4cd6-b031-7000664b76d4 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:38.008980 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-1c85b357-d03e-4cd6-b031-7000664b76d4 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:38.040530 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-53ed6dc8-8280-461b-92d8-462aa56e3279 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-863584851", "imageRef": "c0aabcc0-d4af-4f0e-b8a5-d140344fce1f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "61fecd84-12d8-4d6c-a6e7-c642370f59bf"}], "security_groups": [{"name": "tempest-securitygroup--1742645689"}], "key_name": "tempest-keypair-2143444063", "user_data": "}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:11:38.192784 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.network.neutron [None req-53ed6dc8-8280-461b-92d8-462aa56e3279 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] validate_networks() for [('61fecd84-12d8-4d6c-a6e7-c642370f59bf', None, None, None, None, None)] {{(pid=119410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 13:11:38.197661 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-1c85b357-d03e-4cd6-b031-7000664b76d4 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:38.205926 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-1c85b357-d03e-4cd6-b031-7000664b76d4 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2" status: 200 len: 1265 microversion: 2.1 time: 0.218684 Aug 03 13:11:38.206570 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 549/1094] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:37 2022] GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:38.581764 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-53ed6dc8-8280-461b-92d8-462aa56e3279 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Flavor limits 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 13:11:38.582192 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-53ed6dc8-8280-461b-92d8-462aa56e3279 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Image limits 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 13:11:38.582938 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-53ed6dc8-8280-461b-92d8-462aa56e3279 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Flavor pref 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 13:11:38.584456 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-53ed6dc8-8280-461b-92d8-462aa56e3279 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Image pref 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 13:11:38.584885 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-53ed6dc8-8280-461b-92d8-462aa56e3279 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 13:11:38.594954 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-53ed6dc8-8280-461b-92d8-462aa56e3279 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:38.595780 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-53ed6dc8-8280-461b-92d8-462aa56e3279 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:38.596736 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-53ed6dc8-8280-461b-92d8-462aa56e3279 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:38.597050 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-53ed6dc8-8280-461b-92d8-462aa56e3279 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:38.615925 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.quota [None req-53ed6dc8-8280-461b-92d8-462aa56e3279 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Getting quotas for project 965502bfffde4ee19c6bd7ea81f08672. Resources: {'instances', 'ram', 'cores'} {{(pid=119410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 13:11:38.620345 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.quota [None req-53ed6dc8-8280-461b-92d8-462aa56e3279 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Getting quotas for user 90109591e9cd43b9aab0fe5b1593e9dd and project 965502bfffde4ee19c6bd7ea81f08672. Resources: {'instances', 'ram', 'cores'} {{(pid=119410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 13:11:38.638884 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-53ed6dc8-8280-461b-92d8-462aa56e3279 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Going to run 1 instances... {{(pid=119410) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 13:11:38.641409 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-53ed6dc8-8280-461b-92d8-462aa56e3279 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0aabcc0-d4af-4f0e-b8a5-d140344fce1f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 13:11:38.769842 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-77ba848f-f358-487c-85e4-e030794767e9 req-a69f1def-469c-4a15-b5d3-09c6dcb57120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a05326d-b738-482a-a346-f9f196543ba2", "name": "network-vif-plugged", "status": "completed", "tag": "a19852f9-3014-490d-ad00-cb10542b8236"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:11:38.770614 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-53ed6dc8-8280-461b-92d8-462aa56e3279 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.734879 Aug 03 13:11:38.777414 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 546/1095] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 3 13:11:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 13:11:38.782147 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-77ba848f-f358-487c-85e4-e030794767e9 req-a69f1def-469c-4a15-b5d3-09c6dcb57120 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:38.782672 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-77ba848f-f358-487c-85e4-e030794767e9 req-a69f1def-469c-4a15-b5d3-09c6dcb57120 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:38.783400 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-bb5f6af0-12fd-489c-a9eb-2d22b8c9c9eb tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:38.784011 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-bb5f6af0-12fd-489c-a9eb-2d22b8c9c9eb tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:38.803465 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-77ba848f-f358-487c-85e4-e030794767e9 req-a69f1def-469c-4a15-b5d3-09c6dcb57120 service nova] Creating event network-vif-plugged:a19852f9-3014-490d-ad00-cb10542b8236 for instance 7a05326d-b738-482a-a346-f9f196543ba2 on hv-cinder-85083 Aug 03 13:11:38.809061 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-77ba848f-f358-487c-85e4-e030794767e9 req-a69f1def-469c-4a15-b5d3-09c6dcb57120 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180311 Aug 03 13:11:38.815843 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 550/1096] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:11:38.870469 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-bb5f6af0-12fd-489c-a9eb-2d22b8c9c9eb tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:38.877702 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-bb5f6af0-12fd-489c-a9eb-2d22b8c9c9eb tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1237 microversion: 2.1 time: 0.098927 Aug 03 13:11:38.878557 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 547/1097] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:38 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1237 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:39.227653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-de2c962e-77ed-45fb-a9d3-c3d6bc1eadaf tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:39.228353 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-de2c962e-77ed-45fb-a9d3-c3d6bc1eadaf tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: 7a05326d-b738-482a-a346-f9f196543ba2] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:39.235177 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-de2c962e-77ed-45fb-a9d3-c3d6bc1eadaf tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:39.235626 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-de2c962e-77ed-45fb-a9d3-c3d6bc1eadaf tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:39.236405 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-de2c962e-77ed-45fb-a9d3-c3d6bc1eadaf tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:39.236845 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-de2c962e-77ed-45fb-a9d3-c3d6bc1eadaf tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:39.377580 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-de2c962e-77ed-45fb-a9d3-c3d6bc1eadaf tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:39.385675 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-de2c962e-77ed-45fb-a9d3-c3d6bc1eadaf tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2" status: 200 len: 1265 microversion: 2.1 time: 0.162638 Aug 03 13:11:39.386255 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 551/1098] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:39 2022] GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:39.902151 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e54515f0-0d3b-424f-84d0-45c00bfcf6f8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:39.902701 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-e54515f0-0d3b-424f-84d0-45c00bfcf6f8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:39.910918 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e54515f0-0d3b-424f-84d0-45c00bfcf6f8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:39.911383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e54515f0-0d3b-424f-84d0-45c00bfcf6f8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:39.912147 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e54515f0-0d3b-424f-84d0-45c00bfcf6f8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:39.912589 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e54515f0-0d3b-424f-84d0-45c00bfcf6f8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:39.977767 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-e54515f0-0d3b-424f-84d0-45c00bfcf6f8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:39.985483 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-e54515f0-0d3b-424f-84d0-45c00bfcf6f8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1241 microversion: 2.1 time: 0.087365 Aug 03 13:11:39.990158 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 548/1099] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:39 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:40.406388 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-4a5a6c09-158e-411f-b984-62aa2ea6cabc tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:40.407126 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-4a5a6c09-158e-411f-b984-62aa2ea6cabc tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: 7a05326d-b738-482a-a346-f9f196543ba2] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:40.414050 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4a5a6c09-158e-411f-b984-62aa2ea6cabc tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:40.414503 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4a5a6c09-158e-411f-b984-62aa2ea6cabc tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:40.419020 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4a5a6c09-158e-411f-b984-62aa2ea6cabc tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:40.419020 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4a5a6c09-158e-411f-b984-62aa2ea6cabc tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:40.552560 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-4a5a6c09-158e-411f-b984-62aa2ea6cabc tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:40.560165 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-4a5a6c09-158e-411f-b984-62aa2ea6cabc tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2" status: 200 len: 1265 microversion: 2.1 time: 0.157563 Aug 03 13:11:40.560729 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 552/1100] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:40 2022] GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:41.005592 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-4e2c796a-d71c-428e-b6f0-82994b50acef tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:41.011911 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-4e2c796a-d71c-428e-b6f0-82994b50acef tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:41.013005 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4e2c796a-d71c-428e-b6f0-82994b50acef tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:41.013454 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4e2c796a-d71c-428e-b6f0-82994b50acef tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:41.014243 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4e2c796a-d71c-428e-b6f0-82994b50acef tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:41.014657 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4e2c796a-d71c-428e-b6f0-82994b50acef tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:41.082493 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-4e2c796a-d71c-428e-b6f0-82994b50acef tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:41.093815 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-4e2c796a-d71c-428e-b6f0-82994b50acef tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1289 microversion: 2.1 time: 0.092053 Aug 03 13:11:41.106266 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 549/1101] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:41 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1289 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:41.582222 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-3309dd50-49c7-41fc-b4df-fd49eeca9b51 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:41.582815 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-3309dd50-49c7-41fc-b4df-fd49eeca9b51 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: 7a05326d-b738-482a-a346-f9f196543ba2] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:41.589339 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3309dd50-49c7-41fc-b4df-fd49eeca9b51 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:41.589779 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3309dd50-49c7-41fc-b4df-fd49eeca9b51 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:41.590566 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3309dd50-49c7-41fc-b4df-fd49eeca9b51 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:41.591031 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3309dd50-49c7-41fc-b4df-fd49eeca9b51 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:41.724608 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-3309dd50-49c7-41fc-b4df-fd49eeca9b51 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:41.732129 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-3309dd50-49c7-41fc-b4df-fd49eeca9b51 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2" status: 200 len: 1451 microversion: 2.1 time: 0.153827 Aug 03 13:11:41.732681 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 553/1102] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:41 2022] GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:41.753312 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-376a7de1-ae86-4ee0-b9f4-5a73e6ac9881 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:41.753914 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-376a7de1-ae86-4ee0-b9f4-5a73e6ac9881 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: 7a05326d-b738-482a-a346-f9f196543ba2] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:41.759880 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-376a7de1-ae86-4ee0-b9f4-5a73e6ac9881 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:41.760328 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-376a7de1-ae86-4ee0-b9f4-5a73e6ac9881 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:41.761072 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-376a7de1-ae86-4ee0-b9f4-5a73e6ac9881 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:41.761498 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-376a7de1-ae86-4ee0-b9f4-5a73e6ac9881 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:41.899257 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-376a7de1-ae86-4ee0-b9f4-5a73e6ac9881 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:41.908003 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-376a7de1-ae86-4ee0-b9f4-5a73e6ac9881 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2" status: 200 len: 1451 microversion: 2.1 time: 0.159729 Aug 03 13:11:41.908566 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 550/1103] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:41 2022] GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2 => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:42.115323 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-02fffd20-e9d2-4eef-b1ca-7a7df039a83d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:42.116005 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-02fffd20-e9d2-4eef-b1ca-7a7df039a83d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:42.122024 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-02fffd20-e9d2-4eef-b1ca-7a7df039a83d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:42.122558 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-02fffd20-e9d2-4eef-b1ca-7a7df039a83d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:42.123402 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-02fffd20-e9d2-4eef-b1ca-7a7df039a83d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:42.124477 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-02fffd20-e9d2-4eef-b1ca-7a7df039a83d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:42.193518 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-02fffd20-e9d2-4eef-b1ca-7a7df039a83d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:42.201209 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-02fffd20-e9d2-4eef-b1ca-7a7df039a83d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1289 microversion: 2.1 time: 0.089770 Aug 03 13:11:42.201891 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 554/1104] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:42 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1289 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:43.221738 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-0273b574-2e94-4fe8-81c4-7b5c784b67bf tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:43.222360 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-0273b574-2e94-4fe8-81c4-7b5c784b67bf tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:43.229091 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0273b574-2e94-4fe8-81c4-7b5c784b67bf tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:43.229564 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0273b574-2e94-4fe8-81c4-7b5c784b67bf tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:43.230322 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0273b574-2e94-4fe8-81c4-7b5c784b67bf tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:43.230777 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0273b574-2e94-4fe8-81c4-7b5c784b67bf tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:43.298533 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-0273b574-2e94-4fe8-81c4-7b5c784b67bf tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:43.306048 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-0273b574-2e94-4fe8-81c4-7b5c784b67bf tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1289 microversion: 2.1 time: 0.088343 Aug 03 13:11:43.306623 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 551/1105] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:43 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1289 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:44.188555 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-081b3f6d-a001-48be-a3f4-a6cc1e16d935 req-c2413794-d39d-41cc-8fc2-73078a2a5f20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a05326d-b738-482a-a346-f9f196543ba2", "tag": "a19852f9-3014-490d-ad00-cb10542b8236"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:11:44.199705 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-081b3f6d-a001-48be-a3f4-a6cc1e16d935 req-c2413794-d39d-41cc-8fc2-73078a2a5f20 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:44.200145 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-081b3f6d-a001-48be-a3f4-a6cc1e16d935 req-c2413794-d39d-41cc-8fc2-73078a2a5f20 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:44.211830 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-081b3f6d-a001-48be-a3f4-a6cc1e16d935 req-c2413794-d39d-41cc-8fc2-73078a2a5f20 service nova] Creating event network-changed:a19852f9-3014-490d-ad00-cb10542b8236 for instance 7a05326d-b738-482a-a346-f9f196543ba2 on hv-cinder-85083 Aug 03 13:11:44.216555 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-081b3f6d-a001-48be-a3f4-a6cc1e16d935 req-c2413794-d39d-41cc-8fc2-73078a2a5f20 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088850 Aug 03 13:11:44.217135 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 555/1106] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:11:44.327245 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-96fa8fbb-2bfd-4adb-a790-a6d5df62892c tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:44.327864 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-96fa8fbb-2bfd-4adb-a790-a6d5df62892c tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:44.334311 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-96fa8fbb-2bfd-4adb-a790-a6d5df62892c tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:44.334795 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-96fa8fbb-2bfd-4adb-a790-a6d5df62892c tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:44.335576 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-96fa8fbb-2bfd-4adb-a790-a6d5df62892c tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:44.336015 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-96fa8fbb-2bfd-4adb-a790-a6d5df62892c tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:44.419819 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-96fa8fbb-2bfd-4adb-a790-a6d5df62892c tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:44.428429 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-96fa8fbb-2bfd-4adb-a790-a6d5df62892c tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1289 microversion: 2.1 time: 0.105016 Aug 03 13:11:44.428989 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 552/1107] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:44 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1289 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:45.453639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-78eab196-1ddc-4170-9075-e924fd6debd8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:45.454515 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-78eab196-1ddc-4170-9075-e924fd6debd8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:45.460712 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-78eab196-1ddc-4170-9075-e924fd6debd8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:45.461159 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-78eab196-1ddc-4170-9075-e924fd6debd8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:45.461923 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-78eab196-1ddc-4170-9075-e924fd6debd8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:45.462356 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-78eab196-1ddc-4170-9075-e924fd6debd8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:45.524164 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-78eab196-1ddc-4170-9075-e924fd6debd8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:45.531536 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-78eab196-1ddc-4170-9075-e924fd6debd8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1297 microversion: 2.1 time: 0.085905 Aug 03 13:11:45.532093 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 556/1108] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:45 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:46.553042 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d52c8127-cd4a-4671-86a0-1cb872fecadd tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:46.553582 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d52c8127-cd4a-4671-86a0-1cb872fecadd tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:46.560050 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d52c8127-cd4a-4671-86a0-1cb872fecadd tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:46.560506 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d52c8127-cd4a-4671-86a0-1cb872fecadd tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:46.561281 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d52c8127-cd4a-4671-86a0-1cb872fecadd tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:46.561721 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d52c8127-cd4a-4671-86a0-1cb872fecadd tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:46.625749 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d52c8127-cd4a-4671-86a0-1cb872fecadd tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:46.633802 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d52c8127-cd4a-4671-86a0-1cb872fecadd tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1295 microversion: 2.1 time: 0.084707 Aug 03 13:11:46.645800 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 553/1109] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:46 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1295 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:47.655520 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-db3f8486-db8b-4823-9e13-682ead1f5d34 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:47.656724 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-db3f8486-db8b-4823-9e13-682ead1f5d34 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:47.663704 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-db3f8486-db8b-4823-9e13-682ead1f5d34 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:47.664247 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-db3f8486-db8b-4823-9e13-682ead1f5d34 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:47.665021 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-db3f8486-db8b-4823-9e13-682ead1f5d34 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:47.665460 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-db3f8486-db8b-4823-9e13-682ead1f5d34 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:47.805653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-db3f8486-db8b-4823-9e13-682ead1f5d34 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:47.814361 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-db3f8486-db8b-4823-9e13-682ead1f5d34 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1363 microversion: 2.1 time: 0.162585 Aug 03 13:11:47.815173 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 557/1110] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:47 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:48.049141 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-0e9c46f7-a1f3-434a-a587-37f976ac135c req-73566667-b35e-45dd-9fb7-78b7be2dac23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "327747f6-507a-42b7-a7bc-56b2947b0d25", "tag": "3d2c161e-d182-46f5-86bd-f86a50b004bd"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:11:48.059272 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-0e9c46f7-a1f3-434a-a587-37f976ac135c req-73566667-b35e-45dd-9fb7-78b7be2dac23 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:48.059692 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-0e9c46f7-a1f3-434a-a587-37f976ac135c req-73566667-b35e-45dd-9fb7-78b7be2dac23 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:48.072680 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-0e9c46f7-a1f3-434a-a587-37f976ac135c req-73566667-b35e-45dd-9fb7-78b7be2dac23 service nova] Creating event network-changed:3d2c161e-d182-46f5-86bd-f86a50b004bd for instance 327747f6-507a-42b7-a7bc-56b2947b0d25 on hv-cinder-85083 Aug 03 13:11:48.078416 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-0e9c46f7-a1f3-434a-a587-37f976ac135c req-73566667-b35e-45dd-9fb7-78b7be2dac23 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032851 Aug 03 13:11:48.079269 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 554/1111] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:11:48.835196 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-43fc98c6-7e88-4a47-ada7-5fedfa0b33d4 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:48.835881 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-43fc98c6-7e88-4a47-ada7-5fedfa0b33d4 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:48.842380 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-43fc98c6-7e88-4a47-ada7-5fedfa0b33d4 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:48.842853 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-43fc98c6-7e88-4a47-ada7-5fedfa0b33d4 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:48.843802 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-43fc98c6-7e88-4a47-ada7-5fedfa0b33d4 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:48.844227 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-43fc98c6-7e88-4a47-ada7-5fedfa0b33d4 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:48.976357 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-43fc98c6-7e88-4a47-ada7-5fedfa0b33d4 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:48.984471 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-43fc98c6-7e88-4a47-ada7-5fedfa0b33d4 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1363 microversion: 2.1 time: 0.152643 Aug 03 13:11:48.985224 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 558/1112] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:48 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:50.002057 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=2 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:50.002938 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=12 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:50.008195 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-025563f1-b8b4-48e7-8ddf-ccb15378754e tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:50.008885 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-025563f1-b8b4-48e7-8ddf-ccb15378754e tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:50.015186 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-025563f1-b8b4-48e7-8ddf-ccb15378754e tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:50.015564 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-025563f1-b8b4-48e7-8ddf-ccb15378754e tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:50.016345 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-025563f1-b8b4-48e7-8ddf-ccb15378754e tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:50.016777 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-025563f1-b8b4-48e7-8ddf-ccb15378754e tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:50.153212 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-025563f1-b8b4-48e7-8ddf-ccb15378754e tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:50.161267 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-025563f1-b8b4-48e7-8ddf-ccb15378754e tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1363 microversion: 2.1 time: 0.159827 Aug 03 13:11:50.161880 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 555/1113] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:49 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:51.181312 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-e66b33f5-b3b2-4e62-8d0d-8763dcc71838 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:51.181970 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-e66b33f5-b3b2-4e62-8d0d-8763dcc71838 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:51.188432 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e66b33f5-b3b2-4e62-8d0d-8763dcc71838 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:51.188819 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e66b33f5-b3b2-4e62-8d0d-8763dcc71838 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:51.189604 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e66b33f5-b3b2-4e62-8d0d-8763dcc71838 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:51.190067 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e66b33f5-b3b2-4e62-8d0d-8763dcc71838 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:51.321730 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-e66b33f5-b3b2-4e62-8d0d-8763dcc71838 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:51.329228 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-e66b33f5-b3b2-4e62-8d0d-8763dcc71838 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1363 microversion: 2.1 time: 0.151752 Aug 03 13:11:51.329864 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 559/1114] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:51 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:52.351072 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-7776fd86-6f37-437e-a49e-d77cd60506d2 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:52.351625 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-7776fd86-6f37-437e-a49e-d77cd60506d2 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:52.358064 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7776fd86-6f37-437e-a49e-d77cd60506d2 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:52.358506 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7776fd86-6f37-437e-a49e-d77cd60506d2 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:52.359314 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7776fd86-6f37-437e-a49e-d77cd60506d2 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:52.359746 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7776fd86-6f37-437e-a49e-d77cd60506d2 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:52.488518 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-7776fd86-6f37-437e-a49e-d77cd60506d2 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:52.498264 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-7776fd86-6f37-437e-a49e-d77cd60506d2 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1363 microversion: 2.1 time: 0.151773 Aug 03 13:11:52.498863 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 556/1115] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:52 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:53.520960 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-a8f07660-e8dc-445d-aad2-c0404edd3340 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:53.521546 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-a8f07660-e8dc-445d-aad2-c0404edd3340 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:53.528077 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a8f07660-e8dc-445d-aad2-c0404edd3340 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:53.528521 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a8f07660-e8dc-445d-aad2-c0404edd3340 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:53.529267 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a8f07660-e8dc-445d-aad2-c0404edd3340 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:53.529692 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a8f07660-e8dc-445d-aad2-c0404edd3340 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:53.662563 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-a8f07660-e8dc-445d-aad2-c0404edd3340 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:53.670072 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-a8f07660-e8dc-445d-aad2-c0404edd3340 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1363 microversion: 2.1 time: 0.153680 Aug 03 13:11:53.670622 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 560/1116] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:53 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:54.691758 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-fd7c6cd3-d336-47de-8c0f-2ece568f4a4a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:54.696148 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-fd7c6cd3-d336-47de-8c0f-2ece568f4a4a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:54.699271 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fd7c6cd3-d336-47de-8c0f-2ece568f4a4a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:54.699725 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fd7c6cd3-d336-47de-8c0f-2ece568f4a4a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:54.700489 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fd7c6cd3-d336-47de-8c0f-2ece568f4a4a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:54.700918 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fd7c6cd3-d336-47de-8c0f-2ece568f4a4a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:54.761730 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-72e125d6-44d2-4f92-aeea-e50a86109428 req-776ae6df-ba86-4407-ab22-bf028f630627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "327747f6-507a-42b7-a7bc-56b2947b0d25", "name": "network-vif-plugged", "status": "completed", "tag": "3d2c161e-d182-46f5-86bd-f86a50b004bd"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:11:54.780492 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-72e125d6-44d2-4f92-aeea-e50a86109428 req-776ae6df-ba86-4407-ab22-bf028f630627 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:54.780929 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-72e125d6-44d2-4f92-aeea-e50a86109428 req-776ae6df-ba86-4407-ab22-bf028f630627 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:54.795858 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-72e125d6-44d2-4f92-aeea-e50a86109428 req-776ae6df-ba86-4407-ab22-bf028f630627 service nova] Creating event network-vif-plugged:3d2c161e-d182-46f5-86bd-f86a50b004bd for instance 327747f6-507a-42b7-a7bc-56b2947b0d25 on hv-cinder-85083 Aug 03 13:11:54.801369 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-72e125d6-44d2-4f92-aeea-e50a86109428 req-776ae6df-ba86-4407-ab22-bf028f630627 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044495 Aug 03 13:11:54.802164 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 561/1117] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:11:54.843502 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-fd7c6cd3-d336-47de-8c0f-2ece568f4a4a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:54.852284 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-fd7c6cd3-d336-47de-8c0f-2ece568f4a4a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1363 microversion: 2.1 time: 0.164362 Aug 03 13:11:54.852866 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 557/1118] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:54 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:55.873184 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-e2841e79-f085-4961-914f-bd58c8d7a13f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:55.873866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-e2841e79-f085-4961-914f-bd58c8d7a13f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:55.880541 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e2841e79-f085-4961-914f-bd58c8d7a13f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:55.880982 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e2841e79-f085-4961-914f-bd58c8d7a13f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:55.881726 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e2841e79-f085-4961-914f-bd58c8d7a13f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:55.882171 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e2841e79-f085-4961-914f-bd58c8d7a13f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:56.159738 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-e2841e79-f085-4961-914f-bd58c8d7a13f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:56.167839 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-e2841e79-f085-4961-914f-bd58c8d7a13f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1363 microversion: 2.1 time: 0.298711 Aug 03 13:11:56.168761 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 562/1119] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:55 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1363 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:57.188593 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d0a29577-d82b-43cb-8f4c-0d7630a8a2db tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:57.189206 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d0a29577-d82b-43cb-8f4c-0d7630a8a2db tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:57.196434 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d0a29577-d82b-43cb-8f4c-0d7630a8a2db tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:57.196886 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d0a29577-d82b-43cb-8f4c-0d7630a8a2db tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:57.197641 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d0a29577-d82b-43cb-8f4c-0d7630a8a2db tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:57.198073 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d0a29577-d82b-43cb-8f4c-0d7630a8a2db tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:57.331588 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d0a29577-d82b-43cb-8f4c-0d7630a8a2db tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:11:57.339178 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d0a29577-d82b-43cb-8f4c-0d7630a8a2db tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1548 microversion: 2.1 time: 0.154385 Aug 03 13:11:57.339746 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 558/1120] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:11:57 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:11:57.359850 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d1478b40-d8fb-4f72-aa6e-113a7682fe4a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:11:57.360775 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-d1478b40-d8fb-4f72-aa6e-113a7682fe4a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:11:57.367552 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d1478b40-d8fb-4f72-aa6e-113a7682fe4a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:57.367971 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d1478b40-d8fb-4f72-aa6e-113a7682fe4a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:57.368733 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d1478b40-d8fb-4f72-aa6e-113a7682fe4a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:57.369163 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d1478b40-d8fb-4f72-aa6e-113a7682fe4a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:57.385559 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=100 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:57.446695 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-d1478b40-d8fb-4f72-aa6e-113a7682fe4a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090630 Aug 03 13:11:57.447370 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 563/1121] 10.222.0.64 () {58 vars in 1275 bytes} [Wed Aug 3 13:11:57 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:11:58.442917 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-05f3a6ca-7412-47a8-96df-5532f425d320 req-13038c2d-8dda-4298-bf8e-5e4f9d804554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "327747f6-507a-42b7-a7bc-56b2947b0d25", "tag": "3d2c161e-d182-46f5-86bd-f86a50b004bd"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:11:58.453426 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-05f3a6ca-7412-47a8-96df-5532f425d320 req-13038c2d-8dda-4298-bf8e-5e4f9d804554 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:11:58.453966 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-05f3a6ca-7412-47a8-96df-5532f425d320 req-13038c2d-8dda-4298-bf8e-5e4f9d804554 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:11:58.464694 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-05f3a6ca-7412-47a8-96df-5532f425d320 req-13038c2d-8dda-4298-bf8e-5e4f9d804554 service nova] Creating event network-changed:3d2c161e-d182-46f5-86bd-f86a50b004bd for instance 327747f6-507a-42b7-a7bc-56b2947b0d25 on hv-cinder-85083 Aug 03 13:11:58.469774 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-05f3a6ca-7412-47a8-96df-5532f425d320 req-13038c2d-8dda-4298-bf8e-5e4f9d804554 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030590 Aug 03 13:11:58.470577 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 559/1122] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:12:35.711216 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=35 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:35.715403 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d31be7ea-2414-49e4-b11f-a4ceeae56dd4 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:12:35.715920 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-d31be7ea-2414-49e4-b11f-a4ceeae56dd4 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:12:35.722078 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d31be7ea-2414-49e4-b11f-a4ceeae56dd4 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:35.722523 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d31be7ea-2414-49e4-b11f-a4ceeae56dd4 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:35.723316 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d31be7ea-2414-49e4-b11f-a4ceeae56dd4 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:35.723751 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d31be7ea-2414-49e4-b11f-a4ceeae56dd4 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:35.748320 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.objects.instance [None req-d31be7ea-2414-49e4-b11f-a4ceeae56dd4 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lazy-loading 'flavor' on Instance uuid b1370967-b0b8-4afe-99a9-142716f118bb {{(pid=119409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:12:36.025770 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-d31be7ea-2414-49e4-b11f-a4ceeae56dd4 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "POST /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb/action" status: 202 len: 0 microversion: 2.1 time: 0.315788 Aug 03 13:12:36.026539 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 564/1123] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Aug 3 13:12:35 2022] POST /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 13:12:36.041839 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-6f391621-991f-4fab-b3d8-f3150aaee837 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:12:36.043058 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-6f391621-991f-4fab-b3d8-f3150aaee837 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:12:36.046246 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:36.047304 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=97 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:36.051132 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6f391621-991f-4fab-b3d8-f3150aaee837 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:36.056195 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6f391621-991f-4fab-b3d8-f3150aaee837 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:36.056195 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6f391621-991f-4fab-b3d8-f3150aaee837 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:36.056195 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6f391621-991f-4fab-b3d8-f3150aaee837 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:36.203988 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-6f391621-991f-4fab-b3d8-f3150aaee837 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:12:36.212370 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-6f391621-991f-4fab-b3d8-f3150aaee837 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1569 microversion: 2.1 time: 0.181414 Aug 03 13:12:36.212944 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 560/1124] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:12:36 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:12:37.234210 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-6c2b2ed5-d2e8-430c-b889-7f843e1c495e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:12:37.234931 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-6c2b2ed5-d2e8-430c-b889-7f843e1c495e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:12:37.241832 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6c2b2ed5-d2e8-430c-b889-7f843e1c495e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:37.242276 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6c2b2ed5-d2e8-430c-b889-7f843e1c495e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:37.243054 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6c2b2ed5-d2e8-430c-b889-7f843e1c495e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:37.243485 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6c2b2ed5-d2e8-430c-b889-7f843e1c495e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:37.377518 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-6c2b2ed5-d2e8-430c-b889-7f843e1c495e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:12:37.385010 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-6c2b2ed5-d2e8-430c-b889-7f843e1c495e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1569 microversion: 2.1 time: 0.155427 Aug 03 13:12:37.385566 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 565/1125] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:12:37 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:12:38.407385 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-cd581e26-3e09-4949-8516-ca4961bed299 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:12:38.407995 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-cd581e26-3e09-4949-8516-ca4961bed299 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:12:38.415728 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cd581e26-3e09-4949-8516-ca4961bed299 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:38.416179 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cd581e26-3e09-4949-8516-ca4961bed299 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:38.416932 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cd581e26-3e09-4949-8516-ca4961bed299 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:38.417373 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-cd581e26-3e09-4949-8516-ca4961bed299 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:38.549817 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-cd581e26-3e09-4949-8516-ca4961bed299 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:12:38.557376 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-cd581e26-3e09-4949-8516-ca4961bed299 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1569 microversion: 2.1 time: 0.153849 Aug 03 13:12:38.557950 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 561/1126] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:12:38 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:12:39.579423 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-72b905a3-296d-4446-a8e5-c4c5eeb3b227 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:12:39.579966 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-72b905a3-296d-4446-a8e5-c4c5eeb3b227 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:12:39.586912 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-72b905a3-296d-4446-a8e5-c4c5eeb3b227 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:39.587359 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-72b905a3-296d-4446-a8e5-c4c5eeb3b227 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:39.588116 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-72b905a3-296d-4446-a8e5-c4c5eeb3b227 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:39.588547 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-72b905a3-296d-4446-a8e5-c4c5eeb3b227 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:39.716740 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-72b905a3-296d-4446-a8e5-c4c5eeb3b227 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:12:39.724832 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-72b905a3-296d-4446-a8e5-c4c5eeb3b227 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1569 microversion: 2.1 time: 0.149275 Aug 03 13:12:39.725396 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 566/1127] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:12:39 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:12:40.746397 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-fb6ac8a5-f590-4db6-bfd7-c6a9d787469c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:12:40.747040 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-fb6ac8a5-f590-4db6-bfd7-c6a9d787469c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:12:40.753589 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fb6ac8a5-f590-4db6-bfd7-c6a9d787469c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:40.754043 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fb6ac8a5-f590-4db6-bfd7-c6a9d787469c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:40.754919 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fb6ac8a5-f590-4db6-bfd7-c6a9d787469c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:40.755304 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fb6ac8a5-f590-4db6-bfd7-c6a9d787469c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:40.892981 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-fb6ac8a5-f590-4db6-bfd7-c6a9d787469c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:12:40.901539 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-fb6ac8a5-f590-4db6-bfd7-c6a9d787469c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1569 microversion: 2.1 time: 0.159022 Aug 03 13:12:40.902421 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 562/1128] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:12:40 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:12:41.923729 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-83afadcf-466d-421c-a2d1-bea1a73c6ddf tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:12:41.924365 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-83afadcf-466d-421c-a2d1-bea1a73c6ddf tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:12:41.931025 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-83afadcf-466d-421c-a2d1-bea1a73c6ddf tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:41.931466 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-83afadcf-466d-421c-a2d1-bea1a73c6ddf tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:41.932222 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-83afadcf-466d-421c-a2d1-bea1a73c6ddf tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:41.932652 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-83afadcf-466d-421c-a2d1-bea1a73c6ddf tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:42.065876 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-83afadcf-466d-421c-a2d1-bea1a73c6ddf tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:12:42.074039 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-83afadcf-466d-421c-a2d1-bea1a73c6ddf tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1569 microversion: 2.1 time: 0.154225 Aug 03 13:12:42.074670 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 567/1129] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:12:41 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:12:43.095265 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-77803f57-7fd3-423d-9887-32940b029716 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:12:43.095864 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-77803f57-7fd3-423d-9887-32940b029716 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:12:43.102385 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-77803f57-7fd3-423d-9887-32940b029716 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:43.102871 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-77803f57-7fd3-423d-9887-32940b029716 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:43.103616 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-77803f57-7fd3-423d-9887-32940b029716 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:43.104046 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-77803f57-7fd3-423d-9887-32940b029716 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:43.242141 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-77803f57-7fd3-423d-9887-32940b029716 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:12:43.249694 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-77803f57-7fd3-423d-9887-32940b029716 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1569 microversion: 2.1 time: 0.158363 Aug 03 13:12:43.250298 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 563/1130] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:12:43 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:12:44.271516 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-a4ebe86c-f1f8-44f7-bebb-214ef14f4660 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:12:44.272134 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-a4ebe86c-f1f8-44f7-bebb-214ef14f4660 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:12:44.279113 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a4ebe86c-f1f8-44f7-bebb-214ef14f4660 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:44.279562 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a4ebe86c-f1f8-44f7-bebb-214ef14f4660 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:44.280319 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a4ebe86c-f1f8-44f7-bebb-214ef14f4660 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:44.280758 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a4ebe86c-f1f8-44f7-bebb-214ef14f4660 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:44.411014 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-a4ebe86c-f1f8-44f7-bebb-214ef14f4660 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:12:44.418855 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-a4ebe86c-f1f8-44f7-bebb-214ef14f4660 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1569 microversion: 2.1 time: 0.151319 Aug 03 13:12:44.419435 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 568/1131] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:12:44 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:12:45.442310 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-236ef576-6474-4136-806e-56b55e972c14 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:12:45.442969 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-236ef576-6474-4136-806e-56b55e972c14 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:12:45.449577 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-236ef576-6474-4136-806e-56b55e972c14 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:45.450027 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-236ef576-6474-4136-806e-56b55e972c14 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:45.450822 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-236ef576-6474-4136-806e-56b55e972c14 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:45.451265 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-236ef576-6474-4136-806e-56b55e972c14 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:45.580935 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-236ef576-6474-4136-806e-56b55e972c14 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:12:45.589711 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-236ef576-6474-4136-806e-56b55e972c14 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1569 microversion: 2.1 time: 0.151399 Aug 03 13:12:45.590406 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 564/1132] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:12:45 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:12:46.610832 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-bfb700b8-0b78-46d0-b9c6-434158df9b75 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:12:46.611447 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-bfb700b8-0b78-46d0-b9c6-434158df9b75 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:12:46.618027 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bfb700b8-0b78-46d0-b9c6-434158df9b75 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:46.618473 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bfb700b8-0b78-46d0-b9c6-434158df9b75 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:46.619306 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bfb700b8-0b78-46d0-b9c6-434158df9b75 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:46.619757 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bfb700b8-0b78-46d0-b9c6-434158df9b75 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:46.759068 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-bfb700b8-0b78-46d0-b9c6-434158df9b75 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:12:46.767102 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-bfb700b8-0b78-46d0-b9c6-434158df9b75 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1569 microversion: 2.1 time: 0.160209 Aug 03 13:12:46.767673 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 569/1133] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:12:46 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:12:47.789158 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-9724f417-7e42-471f-8515-0e796169eb83 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:12:47.789772 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-9724f417-7e42-471f-8515-0e796169eb83 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:12:47.796987 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9724f417-7e42-471f-8515-0e796169eb83 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:47.797441 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9724f417-7e42-471f-8515-0e796169eb83 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:47.798204 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9724f417-7e42-471f-8515-0e796169eb83 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:47.798644 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9724f417-7e42-471f-8515-0e796169eb83 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:47.927844 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-9724f417-7e42-471f-8515-0e796169eb83 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:12:47.935691 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-9724f417-7e42-471f-8515-0e796169eb83 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1569 microversion: 2.1 time: 0.150693 Aug 03 13:12:47.940824 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 565/1134] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:12:47 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:12:48.957371 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-b31a13a7-0918-4e3e-9169-ffb788769b1c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:12:48.958015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-b31a13a7-0918-4e3e-9169-ffb788769b1c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:12:48.964787 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b31a13a7-0918-4e3e-9169-ffb788769b1c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:48.965565 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b31a13a7-0918-4e3e-9169-ffb788769b1c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:48.966360 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b31a13a7-0918-4e3e-9169-ffb788769b1c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:48.966858 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-b31a13a7-0918-4e3e-9169-ffb788769b1c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:49.124634 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-b31a13a7-0918-4e3e-9169-ffb788769b1c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:12:49.135497 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-b31a13a7-0918-4e3e-9169-ffb788769b1c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1569 microversion: 2.1 time: 0.181951 Aug 03 13:12:49.149534 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 570/1135] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:12:48 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1569 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:12:50.157364 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e7b206cb-3727-45b2-bb68-ee409beb4f2c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:12:50.158194 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-e7b206cb-3727-45b2-bb68-ee409beb4f2c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:12:50.165383 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e7b206cb-3727-45b2-bb68-ee409beb4f2c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:50.166544 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e7b206cb-3727-45b2-bb68-ee409beb4f2c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:50.167355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e7b206cb-3727-45b2-bb68-ee409beb4f2c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:50.167794 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e7b206cb-3727-45b2-bb68-ee409beb4f2c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:50.309785 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-e7b206cb-3727-45b2-bb68-ee409beb4f2c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:12:50.317436 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-e7b206cb-3727-45b2-bb68-ee409beb4f2c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1570 microversion: 2.1 time: 0.164102 Aug 03 13:12:50.317998 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 566/1136] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:12:50 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:12:50.340588 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-3b6fafd5-6edd-472d-b0e1-3d4619865671 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:12:50.341197 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-3b6fafd5-6edd-472d-b0e1-3d4619865671 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:12:50.348416 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3b6fafd5-6edd-472d-b0e1-3d4619865671 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:50.349142 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3b6fafd5-6edd-472d-b0e1-3d4619865671 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:50.350014 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3b6fafd5-6edd-472d-b0e1-3d4619865671 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:50.350681 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3b6fafd5-6edd-472d-b0e1-3d4619865671 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:50.382938 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-3b6fafd5-6edd-472d-b0e1-3d4619865671 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119409) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 03 13:12:50.663684 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3b6fafd5-6edd-472d-b0e1-3d4619865671 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [b729799c-2320-4947-bc4d-b3616f21014f] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 13:12:51.671833 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO oslo.messaging._drivers.impl_rabbit [None req-3b6fafd5-6edd-472d-b0e1-3d4619865671 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [b729799c-2320-4947-bc4d-b3616f21014f] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 41726. Aug 03 13:12:51.677017 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-3b6fafd5-6edd-472d-b0e1-3d4619865671 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "POST /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb/action" status: 202 len: 0 microversion: 2.1 time: 1.341389 Aug 03 13:12:51.683028 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 571/1137] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Aug 3 13:12:50 2022] POST /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb/action => generated 0 bytes in 1344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 13:12:51.688546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-306f3e90-a71e-47eb-b524-1d30691cb17e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:12:51.689265 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-306f3e90-a71e-47eb-b524-1d30691cb17e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:12:51.707864 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-306f3e90-a71e-47eb-b524-1d30691cb17e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:51.708321 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-306f3e90-a71e-47eb-b524-1d30691cb17e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:51.709108 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-306f3e90-a71e-47eb-b524-1d30691cb17e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:51.709577 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-306f3e90-a71e-47eb-b524-1d30691cb17e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:51.853214 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-306f3e90-a71e-47eb-b524-1d30691cb17e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:12:51.861046 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-306f3e90-a71e-47eb-b524-1d30691cb17e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1518 microversion: 2.1 time: 0.176451 Aug 03 13:12:51.861628 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 567/1138] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:12:51 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1518 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:12:52.882378 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-4472af07-e8ec-4c76-8285-9f3b31d3de88 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:12:52.883130 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-4472af07-e8ec-4c76-8285-9f3b31d3de88 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:12:52.893592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4472af07-e8ec-4c76-8285-9f3b31d3de88 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:52.893592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4472af07-e8ec-4c76-8285-9f3b31d3de88 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:52.893592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4472af07-e8ec-4c76-8285-9f3b31d3de88 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:52.893592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4472af07-e8ec-4c76-8285-9f3b31d3de88 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:52.927371 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-315a0490-9f27-4402-918f-3f089a9d4085 req-29b34cf1-4106-4d88-86a7-005255ac3e37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1370967-b0b8-4afe-99a9-142716f118bb", "name": "network-vif-unplugged", "status": "completed", "tag": "12ced69b-7cb0-4bac-a7d5-0b77dc4d6f10"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:12:52.952238 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-315a0490-9f27-4402-918f-3f089a9d4085 req-29b34cf1-4106-4d88-86a7-005255ac3e37 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:52.952769 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-315a0490-9f27-4402-918f-3f089a9d4085 req-29b34cf1-4106-4d88-86a7-005255ac3e37 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:52.971447 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.compute.server_external_events [req-315a0490-9f27-4402-918f-3f089a9d4085 req-29b34cf1-4106-4d88-86a7-005255ac3e37 service nova] Unable to find a host for instance b1370967-b0b8-4afe-99a9-142716f118bb. Dropping event network-vif-unplugged {{(pid=119410) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 03 13:12:52.972955 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-315a0490-9f27-4402-918f-3f089a9d4085 req-29b34cf1-4106-4d88-86a7-005255ac3e37 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.050038 Aug 03 13:12:52.974076 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 568/1139] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 52 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 03 13:12:53.060858 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-4472af07-e8ec-4c76-8285-9f3b31d3de88 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:12:53.068870 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-4472af07-e8ec-4c76-8285-9f3b31d3de88 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1520 microversion: 2.1 time: 0.191117 Aug 03 13:12:53.069407 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 572/1140] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:12:52 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:12:54.096981 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-de318fb5-e628-408d-8b82-b9a82a162e95 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:12:54.097498 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-de318fb5-e628-408d-8b82-b9a82a162e95 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:12:54.103923 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-de318fb5-e628-408d-8b82-b9a82a162e95 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:54.104369 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-de318fb5-e628-408d-8b82-b9a82a162e95 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:54.105133 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-de318fb5-e628-408d-8b82-b9a82a162e95 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:54.105565 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-de318fb5-e628-408d-8b82-b9a82a162e95 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:54.243132 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-de318fb5-e628-408d-8b82-b9a82a162e95 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:12:54.251598 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-de318fb5-e628-408d-8b82-b9a82a162e95 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1520 microversion: 2.1 time: 0.158670 Aug 03 13:12:54.252180 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 569/1141] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:12:54 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:12:55.272433 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-61ae3666-29ab-4299-9ff2-4868e220b6f4 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:12:55.273078 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-61ae3666-29ab-4299-9ff2-4868e220b6f4 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:12:55.280113 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-61ae3666-29ab-4299-9ff2-4868e220b6f4 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:55.280564 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-61ae3666-29ab-4299-9ff2-4868e220b6f4 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:55.281329 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-61ae3666-29ab-4299-9ff2-4868e220b6f4 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:55.281765 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-61ae3666-29ab-4299-9ff2-4868e220b6f4 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:55.417833 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-61ae3666-29ab-4299-9ff2-4868e220b6f4 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:12:55.425334 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-61ae3666-29ab-4299-9ff2-4868e220b6f4 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1576 microversion: 2.1 time: 0.156837 Aug 03 13:12:55.425895 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 573/1142] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:12:55 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:12:56.446532 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-c3942f97-83b3-4425-a871-f6d5b6de9113 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:12:56.447185 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-c3942f97-83b3-4425-a871-f6d5b6de9113 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:12:56.453751 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c3942f97-83b3-4425-a871-f6d5b6de9113 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:56.454204 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c3942f97-83b3-4425-a871-f6d5b6de9113 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:56.454996 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c3942f97-83b3-4425-a871-f6d5b6de9113 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:56.455432 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c3942f97-83b3-4425-a871-f6d5b6de9113 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:56.591859 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c3942f97-83b3-4425-a871-f6d5b6de9113 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:12:56.599603 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-c3942f97-83b3-4425-a871-f6d5b6de9113 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1576 microversion: 2.1 time: 0.157084 Aug 03 13:12:56.607556 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 570/1143] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:12:56 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:12:57.622039 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-3198debc-6a88-486e-9999-11df8ada6f44 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:12:57.622646 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-3198debc-6a88-486e-9999-11df8ada6f44 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:12:57.629289 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3198debc-6a88-486e-9999-11df8ada6f44 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:57.634228 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3198debc-6a88-486e-9999-11df8ada6f44 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:57.634228 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3198debc-6a88-486e-9999-11df8ada6f44 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:57.634228 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3198debc-6a88-486e-9999-11df8ada6f44 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:57.800758 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-3198debc-6a88-486e-9999-11df8ada6f44 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:12:57.809018 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-3198debc-6a88-486e-9999-11df8ada6f44 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1576 microversion: 2.1 time: 0.191313 Aug 03 13:12:57.809500 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 574/1144] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:12:57 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1576 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:12:58.829558 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-10ea7de3-aa03-4631-aa87-ecff1d727d47 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:12:58.830170 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-10ea7de3-aa03-4631-aa87-ecff1d727d47 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:12:58.836616 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-10ea7de3-aa03-4631-aa87-ecff1d727d47 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:58.837064 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-10ea7de3-aa03-4631-aa87-ecff1d727d47 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:58.838434 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-10ea7de3-aa03-4631-aa87-ecff1d727d47 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:12:58.838894 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-10ea7de3-aa03-4631-aa87-ecff1d727d47 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:12:58.975962 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-10ea7de3-aa03-4631-aa87-ecff1d727d47 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:12:58.983626 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-10ea7de3-aa03-4631-aa87-ecff1d727d47 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1576 microversion: 2.1 time: 0.157968 Aug 03 13:12:58.984199 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 571/1145] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:12:58 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:13:00.004835 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-67d9eaa5-9610-45e2-bae3-73f41716757e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:13:00.005540 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-67d9eaa5-9610-45e2-bae3-73f41716757e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:13:00.012934 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-67d9eaa5-9610-45e2-bae3-73f41716757e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:00.013381 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-67d9eaa5-9610-45e2-bae3-73f41716757e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:00.014144 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-67d9eaa5-9610-45e2-bae3-73f41716757e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:00.014607 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-67d9eaa5-9610-45e2-bae3-73f41716757e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:00.149684 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-67d9eaa5-9610-45e2-bae3-73f41716757e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:13:00.157690 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-67d9eaa5-9610-45e2-bae3-73f41716757e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1576 microversion: 2.1 time: 0.156638 Aug 03 13:13:00.158158 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 575/1146] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:12:59 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:13:01.179384 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-75a9a908-2e19-4acb-8638-4746602802ad tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:13:01.179993 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-75a9a908-2e19-4acb-8638-4746602802ad tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:13:01.186589 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-75a9a908-2e19-4acb-8638-4746602802ad tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:01.187071 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-75a9a908-2e19-4acb-8638-4746602802ad tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:01.187827 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-75a9a908-2e19-4acb-8638-4746602802ad tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:01.188243 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-75a9a908-2e19-4acb-8638-4746602802ad tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:01.317982 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-75a9a908-2e19-4acb-8638-4746602802ad tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:13:01.325375 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-75a9a908-2e19-4acb-8638-4746602802ad tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1576 microversion: 2.1 time: 0.149817 Aug 03 13:13:01.325933 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 572/1147] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:13:01 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:13:02.346738 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-3387b575-6374-45f0-bd75-d684b7ccc4e3 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:13:02.347455 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-3387b575-6374-45f0-bd75-d684b7ccc4e3 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:13:02.354485 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3387b575-6374-45f0-bd75-d684b7ccc4e3 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:02.354972 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3387b575-6374-45f0-bd75-d684b7ccc4e3 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:02.355730 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3387b575-6374-45f0-bd75-d684b7ccc4e3 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:02.356164 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3387b575-6374-45f0-bd75-d684b7ccc4e3 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:02.484481 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-3387b575-6374-45f0-bd75-d684b7ccc4e3 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:13:02.492012 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-3387b575-6374-45f0-bd75-d684b7ccc4e3 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1576 microversion: 2.1 time: 0.149207 Aug 03 13:13:02.492567 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 576/1148] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:13:02 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:13:03.513860 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-493d0de6-8e61-4da5-b272-a432959f6f45 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:13:03.514462 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-493d0de6-8e61-4da5-b272-a432959f6f45 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:13:03.520950 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-493d0de6-8e61-4da5-b272-a432959f6f45 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:03.521343 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-493d0de6-8e61-4da5-b272-a432959f6f45 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:03.522091 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-493d0de6-8e61-4da5-b272-a432959f6f45 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:03.522522 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-493d0de6-8e61-4da5-b272-a432959f6f45 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:03.659656 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-493d0de6-8e61-4da5-b272-a432959f6f45 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:13:03.667654 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-493d0de6-8e61-4da5-b272-a432959f6f45 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1576 microversion: 2.1 time: 0.158155 Aug 03 13:13:03.668239 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 573/1149] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:13:03 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:13:04.688443 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ace44d9f-0862-45d8-90d1-11d92bd705c0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:13:04.689059 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-ace44d9f-0862-45d8-90d1-11d92bd705c0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:13:04.695619 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ace44d9f-0862-45d8-90d1-11d92bd705c0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:04.696068 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ace44d9f-0862-45d8-90d1-11d92bd705c0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:04.696828 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ace44d9f-0862-45d8-90d1-11d92bd705c0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:04.697792 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ace44d9f-0862-45d8-90d1-11d92bd705c0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:04.716110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:04.826868 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ace44d9f-0862-45d8-90d1-11d92bd705c0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:13:04.834206 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-ace44d9f-0862-45d8-90d1-11d92bd705c0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1576 microversion: 2.1 time: 0.149638 Aug 03 13:13:04.834783 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 577/1150] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:13:04 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:13:05.857644 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-8d51f41e-3d3b-4cf9-8543-6ce4b88d2967 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:13:05.858354 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-8d51f41e-3d3b-4cf9-8543-6ce4b88d2967 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:13:05.864853 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8d51f41e-3d3b-4cf9-8543-6ce4b88d2967 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:05.865307 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8d51f41e-3d3b-4cf9-8543-6ce4b88d2967 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:05.866072 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8d51f41e-3d3b-4cf9-8543-6ce4b88d2967 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:05.866510 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8d51f41e-3d3b-4cf9-8543-6ce4b88d2967 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:06.001500 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-8d51f41e-3d3b-4cf9-8543-6ce4b88d2967 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:13:06.010038 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-8d51f41e-3d3b-4cf9-8543-6ce4b88d2967 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1576 microversion: 2.1 time: 0.156304 Aug 03 13:13:06.014768 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 574/1151] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:13:05 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:13:07.037709 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-a869d8ea-ff9b-4507-828e-7ead047b2e76 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:13:07.038319 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-a869d8ea-ff9b-4507-828e-7ead047b2e76 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:13:07.040625 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:07.045839 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a869d8ea-ff9b-4507-828e-7ead047b2e76 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:07.046286 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a869d8ea-ff9b-4507-828e-7ead047b2e76 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:07.047069 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a869d8ea-ff9b-4507-828e-7ead047b2e76 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:07.047500 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a869d8ea-ff9b-4507-828e-7ead047b2e76 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:07.180317 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-a869d8ea-ff9b-4507-828e-7ead047b2e76 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:13:07.187778 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-a869d8ea-ff9b-4507-828e-7ead047b2e76 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1576 microversion: 2.1 time: 0.154239 Aug 03 13:13:07.188333 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 578/1152] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:13:07 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:13:08.208838 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-aeec5cfd-2292-4910-9bf1-407530bdc79e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:13:08.209447 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-aeec5cfd-2292-4910-9bf1-407530bdc79e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:13:08.216426 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-aeec5cfd-2292-4910-9bf1-407530bdc79e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:08.216875 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-aeec5cfd-2292-4910-9bf1-407530bdc79e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:08.217627 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-aeec5cfd-2292-4910-9bf1-407530bdc79e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:08.218056 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-aeec5cfd-2292-4910-9bf1-407530bdc79e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:08.221916 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=87 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:08.348283 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-aeec5cfd-2292-4910-9bf1-407530bdc79e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:13:08.358645 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-aeec5cfd-2292-4910-9bf1-407530bdc79e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1576 microversion: 2.1 time: 0.153445 Aug 03 13:13:08.359087 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 575/1153] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:13:08 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:13:09.380226 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d48ec6c1-973f-48fd-99f1-b580d6face02 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:13:09.380825 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-d48ec6c1-973f-48fd-99f1-b580d6face02 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:13:09.387690 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d48ec6c1-973f-48fd-99f1-b580d6face02 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:09.388215 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d48ec6c1-973f-48fd-99f1-b580d6face02 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:09.388981 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d48ec6c1-973f-48fd-99f1-b580d6face02 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:09.389414 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d48ec6c1-973f-48fd-99f1-b580d6face02 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:09.753569 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-d48ec6c1-973f-48fd-99f1-b580d6face02 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:13:09.761588 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-d48ec6c1-973f-48fd-99f1-b580d6face02 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1576 microversion: 2.1 time: 0.385501 Aug 03 13:13:09.762376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 579/1154] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:13:09 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1576 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:13:10.294253 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-9e8458f3-1f1f-4ead-94b3-1f0b219f1557 req-dca19e37-7d63-4164-bb9f-085f36660593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1370967-b0b8-4afe-99a9-142716f118bb", "name": "network-vif-plugged", "status": "completed", "tag": "12ced69b-7cb0-4bac-a7d5-0b77dc4d6f10"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:13:10.299618 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=33 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:10.304762 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-9e8458f3-1f1f-4ead-94b3-1f0b219f1557 req-dca19e37-7d63-4164-bb9f-085f36660593 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:10.305207 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-9e8458f3-1f1f-4ead-94b3-1f0b219f1557 req-dca19e37-7d63-4164-bb9f-085f36660593 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:10.316719 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-9e8458f3-1f1f-4ead-94b3-1f0b219f1557 req-dca19e37-7d63-4164-bb9f-085f36660593 service nova] Creating event network-vif-plugged:12ced69b-7cb0-4bac-a7d5-0b77dc4d6f10 for instance b1370967-b0b8-4afe-99a9-142716f118bb on hv-cinder-85083 Aug 03 13:13:10.321910 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-9e8458f3-1f1f-4ead-94b3-1f0b219f1557 req-dca19e37-7d63-4164-bb9f-085f36660593 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031507 Aug 03 13:13:10.322496 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 576/1155] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:13:10.783624 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-4cbe0106-7cc1-4d7b-b2aa-eeac6992861e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:13:10.784276 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-4cbe0106-7cc1-4d7b-b2aa-eeac6992861e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:13:10.791074 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4cbe0106-7cc1-4d7b-b2aa-eeac6992861e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:10.791528 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4cbe0106-7cc1-4d7b-b2aa-eeac6992861e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:10.792363 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4cbe0106-7cc1-4d7b-b2aa-eeac6992861e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:10.792802 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4cbe0106-7cc1-4d7b-b2aa-eeac6992861e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:10.923672 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-4cbe0106-7cc1-4d7b-b2aa-eeac6992861e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:13:10.931195 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-4cbe0106-7cc1-4d7b-b2aa-eeac6992861e tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1576 microversion: 2.1 time: 0.151429 Aug 03 13:13:10.931760 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 580/1156] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:13:10 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:13:11.953524 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-c0685ed5-c194-4b96-9809-625c43747fe2 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:13:11.954208 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-c0685ed5-c194-4b96-9809-625c43747fe2 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:13:11.960399 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c0685ed5-c194-4b96-9809-625c43747fe2 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:11.960839 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c0685ed5-c194-4b96-9809-625c43747fe2 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:11.961585 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c0685ed5-c194-4b96-9809-625c43747fe2 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:11.962014 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c0685ed5-c194-4b96-9809-625c43747fe2 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:12.099536 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c0685ed5-c194-4b96-9809-625c43747fe2 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:13:12.107201 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-c0685ed5-c194-4b96-9809-625c43747fe2 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1576 microversion: 2.1 time: 0.158704 Aug 03 13:13:12.107781 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 577/1157] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:13:11 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:13:13.128474 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-44526c5e-0e3d-4595-8dec-ac96355f5600 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:13:13.129080 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-44526c5e-0e3d-4595-8dec-ac96355f5600 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:13:13.135320 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-44526c5e-0e3d-4595-8dec-ac96355f5600 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:13.135769 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-44526c5e-0e3d-4595-8dec-ac96355f5600 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:13.136526 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-44526c5e-0e3d-4595-8dec-ac96355f5600 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:13.136954 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-44526c5e-0e3d-4595-8dec-ac96355f5600 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:13.267607 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-44526c5e-0e3d-4595-8dec-ac96355f5600 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:13:13.275317 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-44526c5e-0e3d-4595-8dec-ac96355f5600 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1563 microversion: 2.1 time: 0.150620 Aug 03 13:13:13.275877 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 581/1158] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:13:13 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:13:40.539356 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-4273cbfc-c5c1-424f-94bf-397faf6d5949 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:13:40.539936 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-4273cbfc-c5c1-424f-94bf-397faf6d5949 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:13:40.541953 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=3 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:40.542610 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=13 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:40.547837 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4273cbfc-c5c1-424f-94bf-397faf6d5949 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:40.548299 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4273cbfc-c5c1-424f-94bf-397faf6d5949 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:40.549058 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4273cbfc-c5c1-424f-94bf-397faf6d5949 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:40.549496 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4273cbfc-c5c1-424f-94bf-397faf6d5949 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:40.572292 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-4273cbfc-c5c1-424f-94bf-397faf6d5949 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25/ips" status: 200 len: 145 microversion: 2.1 time: 0.037279 Aug 03 13:13:40.572859 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 578/1159] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Aug 3 13:13:40 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:13:42.894190 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-faacfc8b-e9c0-4d04-a687-73ba5e3d14bd tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fab359d8-f830-4696-a5a6-1ef981ec6767"}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:13:42.896532 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-faacfc8b-e9c0-4d04-a687-73ba5e3d14bd tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:13:42.898703 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=7 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:42.899402 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=26 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:42.904109 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-faacfc8b-e9c0-4d04-a687-73ba5e3d14bd tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:42.905964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-faacfc8b-e9c0-4d04-a687-73ba5e3d14bd tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:42.905964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-faacfc8b-e9c0-4d04-a687-73ba5e3d14bd tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:42.905964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-faacfc8b-e9c0-4d04-a687-73ba5e3d14bd tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:43.597861 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-faacfc8b-e9c0-4d04-a687-73ba5e3d14bd tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "POST /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.707478 Aug 03 13:13:43.598467 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 582/1160] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Aug 3 13:13:42 2022] POST /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25/os-volume_attachments => generated 194 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:13:52.178807 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-acf09840-9ef4-4ae7-a89c-2d9a983767a6 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:13:52.185944 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-acf09840-9ef4-4ae7-a89c-2d9a983767a6 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:52.186398 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-acf09840-9ef4-4ae7-a89c-2d9a983767a6 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:52.244422 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-acf09840-9ef4-4ae7-a89c-2d9a983767a6 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Going to try to stop instance {{(pid=119410) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 13:13:52.442903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-acf09840-9ef4-4ae7-a89c-2d9a983767a6 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "POST /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25/action" status: 202 len: 0 microversion: 2.1 time: 0.267954 Aug 03 13:13:52.443563 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 579/1161] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Aug 3 13:13:52 2022] POST /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 13:13:52.453549 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-68054edc-26ce-497d-bbc7-7b789a262e00 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:13:52.454065 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-68054edc-26ce-497d-bbc7-7b789a262e00 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:13:52.461289 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-68054edc-26ce-497d-bbc7-7b789a262e00 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:52.463574 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-68054edc-26ce-497d-bbc7-7b789a262e00 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:52.463574 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-68054edc-26ce-497d-bbc7-7b789a262e00 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:52.463574 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-68054edc-26ce-497d-bbc7-7b789a262e00 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:52.594655 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-68054edc-26ce-497d-bbc7-7b789a262e00 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:13:52.602590 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-68054edc-26ce-497d-bbc7-7b789a262e00 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1723 microversion: 2.1 time: 0.154698 Aug 03 13:13:52.603297 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 583/1162] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:13:52 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:13:53.624648 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-99176ec9-f3c1-4ece-acb8-2acbc502b435 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:13:53.625339 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-99176ec9-f3c1-4ece-acb8-2acbc502b435 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:13:53.632005 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-99176ec9-f3c1-4ece-acb8-2acbc502b435 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:53.632445 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-99176ec9-f3c1-4ece-acb8-2acbc502b435 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:53.633219 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-99176ec9-f3c1-4ece-acb8-2acbc502b435 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:53.633644 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-99176ec9-f3c1-4ece-acb8-2acbc502b435 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:53.762364 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-99176ec9-f3c1-4ece-acb8-2acbc502b435 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:13:53.770139 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-99176ec9-f3c1-4ece-acb8-2acbc502b435 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1723 microversion: 2.1 time: 0.149637 Aug 03 13:13:53.770700 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 580/1163] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:13:53 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:13:54.792341 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-2e85fb33-63fb-491a-ae7b-4a7fc9f6be09 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:13:54.792942 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-2e85fb33-63fb-491a-ae7b-4a7fc9f6be09 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:13:54.800012 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2e85fb33-63fb-491a-ae7b-4a7fc9f6be09 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:54.800465 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2e85fb33-63fb-491a-ae7b-4a7fc9f6be09 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:54.801224 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2e85fb33-63fb-491a-ae7b-4a7fc9f6be09 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:54.801662 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2e85fb33-63fb-491a-ae7b-4a7fc9f6be09 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:54.928849 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-2e85fb33-63fb-491a-ae7b-4a7fc9f6be09 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:13:54.937382 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-2e85fb33-63fb-491a-ae7b-4a7fc9f6be09 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1723 microversion: 2.1 time: 0.148986 Aug 03 13:13:54.937927 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 584/1164] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:13:54 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:13:55.958242 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-919a800a-1cea-4b38-9fd5-b5a6620f9c61 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:13:55.958876 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-919a800a-1cea-4b38-9fd5-b5a6620f9c61 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:13:55.965280 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-919a800a-1cea-4b38-9fd5-b5a6620f9c61 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:55.965721 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-919a800a-1cea-4b38-9fd5-b5a6620f9c61 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:55.966465 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-919a800a-1cea-4b38-9fd5-b5a6620f9c61 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:55.966920 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-919a800a-1cea-4b38-9fd5-b5a6620f9c61 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:56.097489 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-919a800a-1cea-4b38-9fd5-b5a6620f9c61 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:13:56.105331 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-919a800a-1cea-4b38-9fd5-b5a6620f9c61 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1723 microversion: 2.1 time: 0.150945 Aug 03 13:13:56.105897 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 581/1165] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:13:55 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:13:57.125984 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-7ae2247f-0510-4a8e-8e76-40d9d9a1d9f7 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:13:57.138677 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-7ae2247f-0510-4a8e-8e76-40d9d9a1d9f7 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:13:57.138677 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7ae2247f-0510-4a8e-8e76-40d9d9a1d9f7 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:57.138677 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7ae2247f-0510-4a8e-8e76-40d9d9a1d9f7 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:57.138677 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7ae2247f-0510-4a8e-8e76-40d9d9a1d9f7 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:57.139133 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7ae2247f-0510-4a8e-8e76-40d9d9a1d9f7 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:57.262198 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-7ae2247f-0510-4a8e-8e76-40d9d9a1d9f7 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:13:57.270132 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-7ae2247f-0510-4a8e-8e76-40d9d9a1d9f7 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1723 microversion: 2.1 time: 0.148654 Aug 03 13:13:57.270698 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 585/1166] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:13:57 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:13:58.296107 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-882dcbf5-7e0b-45c4-8723-c39f13d6bcda tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:13:58.296692 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-882dcbf5-7e0b-45c4-8723-c39f13d6bcda tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:13:58.302687 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-882dcbf5-7e0b-45c4-8723-c39f13d6bcda tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:58.303161 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-882dcbf5-7e0b-45c4-8723-c39f13d6bcda tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:58.303901 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-882dcbf5-7e0b-45c4-8723-c39f13d6bcda tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:58.304323 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-882dcbf5-7e0b-45c4-8723-c39f13d6bcda tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:58.431218 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-882dcbf5-7e0b-45c4-8723-c39f13d6bcda tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:13:58.439830 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-882dcbf5-7e0b-45c4-8723-c39f13d6bcda tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1723 microversion: 2.1 time: 0.147762 Aug 03 13:13:58.440402 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 582/1167] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:13:58 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:13:59.461137 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-7c5c711d-d0b3-428d-9e44-af194118c8f0 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:13:59.461747 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-7c5c711d-d0b3-428d-9e44-af194118c8f0 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:13:59.468870 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7c5c711d-d0b3-428d-9e44-af194118c8f0 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:59.469317 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7c5c711d-d0b3-428d-9e44-af194118c8f0 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:59.470107 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7c5c711d-d0b3-428d-9e44-af194118c8f0 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:59.470542 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7c5c711d-d0b3-428d-9e44-af194118c8f0 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:59.711299 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-7c5c711d-d0b3-428d-9e44-af194118c8f0 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:13:59.719202 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-7c5c711d-d0b3-428d-9e44-af194118c8f0 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1723 microversion: 2.1 time: 0.261873 Aug 03 13:13:59.719767 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 586/1168] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:13:59 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:13:59.979327 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-39719a60-1948-46dc-88dc-7f18559fee78 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:13:59.979829 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-39719a60-1948-46dc-88dc-7f18559fee78 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: 7a05326d-b738-482a-a346-f9f196543ba2] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:13:59.981094 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-d130c406-6e89-4600-a931-3594303eb02b req-51e0b7b3-d594-44ef-b864-4e6bce454e54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a05326d-b738-482a-a346-f9f196543ba2", "tag": "a19852f9-3014-490d-ad00-cb10542b8236"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:13:59.987101 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-39719a60-1948-46dc-88dc-7f18559fee78 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:59.987840 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-39719a60-1948-46dc-88dc-7f18559fee78 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:59.988835 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-39719a60-1948-46dc-88dc-7f18559fee78 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:59.989271 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-39719a60-1948-46dc-88dc-7f18559fee78 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:13:59.990853 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-d130c406-6e89-4600-a931-3594303eb02b req-51e0b7b3-d594-44ef-b864-4e6bce454e54 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:13:59.991287 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-d130c406-6e89-4600-a931-3594303eb02b req-51e0b7b3-d594-44ef-b864-4e6bce454e54 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:00.003237 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-d130c406-6e89-4600-a931-3594303eb02b req-51e0b7b3-d594-44ef-b864-4e6bce454e54 service nova] Creating event network-changed:a19852f9-3014-490d-ad00-cb10542b8236 for instance 7a05326d-b738-482a-a346-f9f196543ba2 on hv-cinder-85083 Aug 03 13:14:00.008272 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-d130c406-6e89-4600-a931-3594303eb02b req-51e0b7b3-d594-44ef-b864-4e6bce454e54 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031465 Aug 03 13:14:00.009063 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 587/1169] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:14:00.017498 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-39719a60-1948-46dc-88dc-7f18559fee78 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: 7a05326d-b738-482a-a346-f9f196543ba2] Going to try to terminate instance {{(pid=119410) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 13:14:00.308849 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-39719a60-1948-46dc-88dc-7f18559fee78 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "DELETE /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2" status: 204 len: 0 microversion: 2.1 time: 0.334031 Aug 03 13:14:00.309735 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 583/1170] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 3 13:13:59 2022] DELETE /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 13:14:00.318545 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-e5538f09-814a-41a8-a05a-430bb487debe tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:00.319300 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-e5538f09-814a-41a8-a05a-430bb487debe tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: 7a05326d-b738-482a-a346-f9f196543ba2] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:00.325626 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e5538f09-814a-41a8-a05a-430bb487debe tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:00.326053 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e5538f09-814a-41a8-a05a-430bb487debe tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:00.326832 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e5538f09-814a-41a8-a05a-430bb487debe tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:00.327394 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-e5538f09-814a-41a8-a05a-430bb487debe tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:00.460731 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-e5538f09-814a-41a8-a05a-430bb487debe tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:14:00.469115 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-e5538f09-814a-41a8-a05a-430bb487debe tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2" status: 200 len: 1576 microversion: 2.1 time: 0.154820 Aug 03 13:14:00.469977 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 588/1171] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:14:00 2022] GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:14:00.740908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-0fdee1fc-725e-43a9-bde8-4712d27cf167 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:00.741594 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-0fdee1fc-725e-43a9-bde8-4712d27cf167 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:00.747839 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0fdee1fc-725e-43a9-bde8-4712d27cf167 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:00.748284 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0fdee1fc-725e-43a9-bde8-4712d27cf167 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:00.749029 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0fdee1fc-725e-43a9-bde8-4712d27cf167 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:00.749457 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0fdee1fc-725e-43a9-bde8-4712d27cf167 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:00.891182 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-0fdee1fc-725e-43a9-bde8-4712d27cf167 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:14:00.899194 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-0fdee1fc-725e-43a9-bde8-4712d27cf167 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1723 microversion: 2.1 time: 0.162421 Aug 03 13:14:00.899766 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 584/1172] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:14:00 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:14:01.490934 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-21184a02-354b-4018-ba8e-7a69bc1ca755 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:01.491526 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-21184a02-354b-4018-ba8e-7a69bc1ca755 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: 7a05326d-b738-482a-a346-f9f196543ba2] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:01.498875 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-21184a02-354b-4018-ba8e-7a69bc1ca755 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:01.499326 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-21184a02-354b-4018-ba8e-7a69bc1ca755 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:01.500123 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-21184a02-354b-4018-ba8e-7a69bc1ca755 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:01.500574 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-21184a02-354b-4018-ba8e-7a69bc1ca755 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:01.633851 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-21184a02-354b-4018-ba8e-7a69bc1ca755 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:14:01.641356 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-21184a02-354b-4018-ba8e-7a69bc1ca755 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2" status: 200 len: 1576 microversion: 2.1 time: 0.154482 Aug 03 13:14:01.641916 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 589/1173] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:14:01 2022] GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:14:01.921468 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-aae00a1c-8b80-4c42-a2c8-c5ceb4c31002 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:01.922080 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-aae00a1c-8b80-4c42-a2c8-c5ceb4c31002 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:01.928678 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-aae00a1c-8b80-4c42-a2c8-c5ceb4c31002 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:01.929129 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-aae00a1c-8b80-4c42-a2c8-c5ceb4c31002 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:01.929892 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-aae00a1c-8b80-4c42-a2c8-c5ceb4c31002 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:01.930328 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-aae00a1c-8b80-4c42-a2c8-c5ceb4c31002 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:02.060027 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-aae00a1c-8b80-4c42-a2c8-c5ceb4c31002 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:14:02.067983 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-aae00a1c-8b80-4c42-a2c8-c5ceb4c31002 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1723 microversion: 2.1 time: 0.151043 Aug 03 13:14:02.068557 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 585/1174] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:14:01 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:14:02.663098 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-2c625f61-d373-4831-b23b-f412d76b035a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:02.663856 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-2c625f61-d373-4831-b23b-f412d76b035a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: 7a05326d-b738-482a-a346-f9f196543ba2] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:02.670271 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2c625f61-d373-4831-b23b-f412d76b035a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:02.670722 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2c625f61-d373-4831-b23b-f412d76b035a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:02.671521 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2c625f61-d373-4831-b23b-f412d76b035a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:02.671957 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2c625f61-d373-4831-b23b-f412d76b035a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:02.734441 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-2c625f61-d373-4831-b23b-f412d76b035a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:14:02.743362 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-2c625f61-d373-4831-b23b-f412d76b035a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2" status: 200 len: 1389 microversion: 2.1 time: 0.084396 Aug 03 13:14:02.757522 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 590/1175] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:14:02 2022] GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2 => generated 1389 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:14:02.816633 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-127b808e-68e2-4109-ab0c-0e49c8cdd5b9 req-7b4a11b6-61d6-44b2-bc7a-b148d942bffd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a05326d-b738-482a-a346-f9f196543ba2", "name": "network-vif-deleted", "tag": "a19852f9-3014-490d-ad00-cb10542b8236"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:14:02.826407 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-127b808e-68e2-4109-ab0c-0e49c8cdd5b9 req-7b4a11b6-61d6-44b2-bc7a-b148d942bffd service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:02.827945 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-127b808e-68e2-4109-ab0c-0e49c8cdd5b9 req-7b4a11b6-61d6-44b2-bc7a-b148d942bffd service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:02.837923 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-127b808e-68e2-4109-ab0c-0e49c8cdd5b9 req-7b4a11b6-61d6-44b2-bc7a-b148d942bffd service nova] Creating event network-vif-deleted:a19852f9-3014-490d-ad00-cb10542b8236 for instance 7a05326d-b738-482a-a346-f9f196543ba2 on hv-cinder-85083 Aug 03 13:14:02.842713 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-127b808e-68e2-4109-ab0c-0e49c8cdd5b9 req-7b4a11b6-61d6-44b2-bc7a-b148d942bffd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030463 Aug 03 13:14:02.843362 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 586/1176] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:14:03.089577 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-001e8438-6331-447d-bfe3-7e16cfa914f3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:03.090267 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-001e8438-6331-447d-bfe3-7e16cfa914f3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:03.096513 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-001e8438-6331-447d-bfe3-7e16cfa914f3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:03.096964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-001e8438-6331-447d-bfe3-7e16cfa914f3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:03.097747 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-001e8438-6331-447d-bfe3-7e16cfa914f3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:03.098176 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-001e8438-6331-447d-bfe3-7e16cfa914f3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:03.234604 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-001e8438-6331-447d-bfe3-7e16cfa914f3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:14:03.242577 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-001e8438-6331-447d-bfe3-7e16cfa914f3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1723 microversion: 2.1 time: 0.156990 Aug 03 13:14:03.243190 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 591/1177] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:14:03 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:14:03.766640 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-963612cd-49db-4b3d-b858-6521ee9c353e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:03.767366 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-963612cd-49db-4b3d-b858-6521ee9c353e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: 7a05326d-b738-482a-a346-f9f196543ba2] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:03.773749 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-963612cd-49db-4b3d-b858-6521ee9c353e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:03.774193 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-963612cd-49db-4b3d-b858-6521ee9c353e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:03.774968 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-963612cd-49db-4b3d-b858-6521ee9c353e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:03.775398 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-963612cd-49db-4b3d-b858-6521ee9c353e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:03.805371 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-963612cd-49db-4b3d-b858-6521ee9c353e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:03.805809 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-963612cd-49db-4b3d-b858-6521ee9c353e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:03.806244 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-963612cd-49db-4b3d-b858-6521ee9c353e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lazy-loading 'fault' on Instance uuid 7a05326d-b738-482a-a346-f9f196543ba2 {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:14:03.852252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-963612cd-49db-4b3d-b858-6521ee9c353e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:14:03.859803 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-963612cd-49db-4b3d-b858-6521ee9c353e tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2" status: 200 len: 1229 microversion: 2.1 time: 0.098639 Aug 03 13:14:03.860497 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 587/1178] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:14:03 2022] GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2 => generated 1229 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:14:04.265031 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-62ede9b1-f19a-4702-bd17-c1e3db02edb9 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:04.265706 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-62ede9b1-f19a-4702-bd17-c1e3db02edb9 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:04.272777 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-62ede9b1-f19a-4702-bd17-c1e3db02edb9 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:04.273232 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-62ede9b1-f19a-4702-bd17-c1e3db02edb9 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:04.273998 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-62ede9b1-f19a-4702-bd17-c1e3db02edb9 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:04.274436 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-62ede9b1-f19a-4702-bd17-c1e3db02edb9 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:04.402068 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-62ede9b1-f19a-4702-bd17-c1e3db02edb9 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:14:04.410064 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-62ede9b1-f19a-4702-bd17-c1e3db02edb9 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1723 microversion: 2.1 time: 0.149860 Aug 03 13:14:04.410564 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 592/1179] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:14:04 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:14:04.883872 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1a7ad207-154b-4986-bc71-00cf9bfa5843 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:04.884504 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-1a7ad207-154b-4986-bc71-00cf9bfa5843 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: 7a05326d-b738-482a-a346-f9f196543ba2] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:04.891689 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1a7ad207-154b-4986-bc71-00cf9bfa5843 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:04.892131 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1a7ad207-154b-4986-bc71-00cf9bfa5843 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:04.892905 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1a7ad207-154b-4986-bc71-00cf9bfa5843 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:04.893362 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1a7ad207-154b-4986-bc71-00cf9bfa5843 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:04.908242 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.wsgi [None req-1a7ad207-154b-4986-bc71-00cf9bfa5843 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] HTTP exception thrown: Instance 7a05326d-b738-482a-a346-f9f196543ba2 could not be found. Aug 03 13:14:04.909820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1a7ad207-154b-4986-bc71-00cf9bfa5843 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Request method failure captured: Aug 03 13:14:04.909820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: request: GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2 HTTP/1.1 Aug 03 13:14:04.909820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept: application/json Aug 03 13:14:04.909820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept-Encoding: identity Aug 03 13:14:04.909820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Connection: close Aug 03 13:14:04.909820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Length: 0 Aug 03 13:14:04.909820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Type: application/json Aug 03 13:14:04.909820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Host: 10.222.0.64 Aug 03 13:14:04.909820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Openstack-System-Scope: None Aug 03 13:14:04.909820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: User-Agent: python-urllib3/1.26.10 Aug 03 13:14:04.909820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Auth-Token: gAAAAABi6nJ4BMxiM3qOr4MBFgilu-HzP9w6Z0P34I4SNv2Ei8q1YsRoFkVbCX-CvQirWaj_9sEHyPAtRXsB2UKF1AHES1D2CvG2OJdZd9TSXlKZyV7szIwANnyCCoTbAruFt5o_V3UrZ-qqMbnA3qqopgm-vDSnazYl4r9GPCsWSdilHdFD8iM Aug 03 13:14:04.909820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Id: None Aug 03 13:14:04.909820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Name: None Aug 03 13:14:04.909820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Identity-Status: Confirmed Aug 03 13:14:04.909820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Is-Admin-Project: True Aug 03 13:14:04.909820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Id: default Aug 03 13:14:04.909820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Name: Default Aug 03 13:14:04.909820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Id: 5c182a81a1c64866944f21c4e26725a3 Aug 03 13:14:04.909820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Name: tempest-TestVolumeBootPattern-62569797 Aug 03 13:14:04.909820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Role: member,reader Aug 03 13:14:04.909820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Roles: member,reader Aug 03 13:14:04.911555 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5c182a81a1c64866944f21c4e26725a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5c182a81a1c64866944f21c4e26725a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5c182a81a1c64866944f21c4e26725a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5c182a81a1c64866944f21c4e26725a3", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:14:04.911555 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant: tempest-TestVolumeBootPattern-62569797 Aug 03 13:14:04.911555 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Id: 5c182a81a1c64866944f21c4e26725a3 Aug 03 13:14:04.911555 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Name: tempest-TestVolumeBootPattern-62569797 Aug 03 13:14:04.911555 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User: tempest-TestVolumeBootPattern-62569797-project Aug 03 13:14:04.911555 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Id: default Aug 03 13:14:04.911555 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Name: Default Aug 03 13:14:04.911555 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Id: b2ccafac03aa420db7f76165f20b0d3b Aug 03 13:14:04.911555 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Name: tempest-TestVolumeBootPattern-62569797-project Aug 03 13:14:04.911555 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: method: > Aug 03 13:14:04.911555 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: exception: Instance 7a05326d-b738-482a-a346-f9f196543ba2 could not be found. Aug 03 13:14:04.911555 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: action_args: {'id': '7a05326d-b738-482a-a346-f9f196543ba2'} Aug 03 13:14:04.912474 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:14:04.912474 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:14:04.912474 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:14:04.912474 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:14:04.912474 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:14:04.912474 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:14:04.912474 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:14:04.912474 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:14:04.912474 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:14:04.912474 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:14:04.912474 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a05326d-b738-482a-a346-f9f196543ba2 could not be found. Aug 03 13:14:04.912474 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:14:04.912474 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:14:04.912474 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:14:04.912474 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:14:04.912474 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:14:04.912474 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:14:04.912474 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:14:04.912474 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:14:04.912474 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:14:04.914095 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:14:04.914095 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:14:04.914095 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:14:04.914095 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:14:04.914095 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:14:04.914095 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:14:04.914095 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:14:04.914095 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a05326d-b738-482a-a346-f9f196543ba2 could not be found. Aug 03 13:14:04.914095 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:14:04.914095 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:14:04.914095 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:14:04.914095 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:14:04.914095 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:14:04.914095 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:14:04.914095 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:14:04.914095 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:14:04.914095 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a05326d-b738-482a-a346-f9f196543ba2 could not be found. Aug 03 13:14:04.914095 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:14:04.915821 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1a7ad207-154b-4986-bc71-00cf9bfa5843 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Returning 404 to user: Instance 7a05326d-b738-482a-a346-f9f196543ba2 could not be found. {{(pid=119410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:14:04.915821 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-1a7ad207-154b-4986-bc71-00cf9bfa5843 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2" status: 404 len: 111 microversion: 2.1 time: 0.031406 Aug 03 13:14:04.915821 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 588/1180] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:14:04 2022] GET /compute/v2.1/servers/7a05326d-b738-482a-a346-f9f196543ba2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:14:05.432818 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-79258fb3-fcd3-4ab7-9470-47150173354c tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:05.434062 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-79258fb3-fcd3-4ab7-9470-47150173354c tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:05.440624 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-79258fb3-fcd3-4ab7-9470-47150173354c tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:05.441073 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-79258fb3-fcd3-4ab7-9470-47150173354c tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:05.441828 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-79258fb3-fcd3-4ab7-9470-47150173354c tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:05.442265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-79258fb3-fcd3-4ab7-9470-47150173354c tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:05.569159 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-79258fb3-fcd3-4ab7-9470-47150173354c tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:14:05.577089 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-79258fb3-fcd3-4ab7-9470-47150173354c tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1723 microversion: 2.1 time: 0.148504 Aug 03 13:14:05.577653 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 593/1181] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:14:05 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:14:06.598538 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-6e96ec39-9b3e-4add-907b-46396500099b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:06.599178 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-6e96ec39-9b3e-4add-907b-46396500099b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:06.605591 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6e96ec39-9b3e-4add-907b-46396500099b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:06.606034 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6e96ec39-9b3e-4add-907b-46396500099b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:06.606808 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6e96ec39-9b3e-4add-907b-46396500099b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:06.607236 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6e96ec39-9b3e-4add-907b-46396500099b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:06.739645 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-6e96ec39-9b3e-4add-907b-46396500099b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:14:06.748247 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-6e96ec39-9b3e-4add-907b-46396500099b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1723 microversion: 2.1 time: 0.153550 Aug 03 13:14:06.748838 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 589/1182] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:14:06 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:14:07.769855 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-f2870207-48fe-4948-b5de-51701e7fd50b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:07.770478 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-f2870207-48fe-4948-b5de-51701e7fd50b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:07.776934 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f2870207-48fe-4948-b5de-51701e7fd50b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:07.780776 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f2870207-48fe-4948-b5de-51701e7fd50b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:07.780776 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f2870207-48fe-4948-b5de-51701e7fd50b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:07.780776 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f2870207-48fe-4948-b5de-51701e7fd50b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:08.016900 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-f2870207-48fe-4948-b5de-51701e7fd50b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:14:08.026498 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-f2870207-48fe-4948-b5de-51701e7fd50b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1723 microversion: 2.1 time: 0.259097 Aug 03 13:14:08.026498 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 594/1183] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:14:07 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:14:08.311104 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-8a2ea9c7-402a-4252-8833-cf92028d42ae tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:08.311654 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-8a2ea9c7-402a-4252-8833-cf92028d42ae tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: eeb53552-b05d-4931-920f-b11bac28243b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:08.318556 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8a2ea9c7-402a-4252-8833-cf92028d42ae tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:08.319045 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8a2ea9c7-402a-4252-8833-cf92028d42ae tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:08.319811 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8a2ea9c7-402a-4252-8833-cf92028d42ae tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:08.320130 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-6475744a-2d22-4221-90ae-ab1b1c95a544 req-55d052f0-c1dc-4e46-8857-bc1487108f17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeb53552-b05d-4931-920f-b11bac28243b", "tag": "1db7a902-7951-431f-9eb7-e35311be4427"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:14:08.320394 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8a2ea9c7-402a-4252-8833-cf92028d42ae tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:08.330197 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-6475744a-2d22-4221-90ae-ab1b1c95a544 req-55d052f0-c1dc-4e46-8857-bc1487108f17 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:08.330631 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-6475744a-2d22-4221-90ae-ab1b1c95a544 req-55d052f0-c1dc-4e46-8857-bc1487108f17 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:08.342493 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-6475744a-2d22-4221-90ae-ab1b1c95a544 req-55d052f0-c1dc-4e46-8857-bc1487108f17 service nova] Creating event network-changed:1db7a902-7951-431f-9eb7-e35311be4427 for instance eeb53552-b05d-4931-920f-b11bac28243b on hv-cinder-85083 Aug 03 13:14:08.347192 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-8a2ea9c7-402a-4252-8833-cf92028d42ae tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: eeb53552-b05d-4931-920f-b11bac28243b] Going to try to terminate instance {{(pid=119410) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 13:14:08.348009 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-6475744a-2d22-4221-90ae-ab1b1c95a544 req-55d052f0-c1dc-4e46-8857-bc1487108f17 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031765 Aug 03 13:14:08.348920 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 595/1184] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:14:08.582488 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-8a2ea9c7-402a-4252-8833-cf92028d42ae tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "DELETE /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b" status: 204 len: 0 microversion: 2.1 time: 0.275146 Aug 03 13:14:08.583328 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 590/1185] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 3 13:14:08 2022] DELETE /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 13:14:08.592049 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-bf252821-7c00-4fef-9725-1115e1ffe44a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:08.593067 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-bf252821-7c00-4fef-9725-1115e1ffe44a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: eeb53552-b05d-4931-920f-b11bac28243b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:08.599339 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bf252821-7c00-4fef-9725-1115e1ffe44a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:08.599787 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bf252821-7c00-4fef-9725-1115e1ffe44a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:08.600558 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bf252821-7c00-4fef-9725-1115e1ffe44a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:08.600999 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bf252821-7c00-4fef-9725-1115e1ffe44a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:08.740089 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-bf252821-7c00-4fef-9725-1115e1ffe44a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:14:08.749387 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-bf252821-7c00-4fef-9725-1115e1ffe44a tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b" status: 200 len: 1577 microversion: 2.1 time: 0.161459 Aug 03 13:14:08.749955 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 596/1186] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:14:08 2022] GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:14:09.049498 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-48afb224-5878-4f67-8849-dd3ecb70964a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:09.050338 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-48afb224-5878-4f67-8849-dd3ecb70964a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:09.056586 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-48afb224-5878-4f67-8849-dd3ecb70964a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:09.057036 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-48afb224-5878-4f67-8849-dd3ecb70964a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:09.057999 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-48afb224-5878-4f67-8849-dd3ecb70964a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:09.058998 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-48afb224-5878-4f67-8849-dd3ecb70964a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:09.077013 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:14:09.196766 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-48afb224-5878-4f67-8849-dd3ecb70964a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:14:09.205037 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-48afb224-5878-4f67-8849-dd3ecb70964a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1700 microversion: 2.1 time: 0.160443 Aug 03 13:14:09.210374 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 591/1187] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:14:09 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1700 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:14:09.226447 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-637d3d3d-7559-4db9-8b16-32bbc9b709a8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:14:09.233675 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-637d3d3d-7559-4db9-8b16-32bbc9b709a8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:09.234111 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-637d3d3d-7559-4db9-8b16-32bbc9b709a8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:09.297789 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-637d3d3d-7559-4db9-8b16-32bbc9b709a8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Going to try to start instance {{(pid=119409) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 03 13:14:09.324563 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:14:09.516866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-637d3d3d-7559-4db9-8b16-32bbc9b709a8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "POST /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25/action" status: 202 len: 0 microversion: 2.1 time: 0.294117 Aug 03 13:14:09.517522 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 597/1188] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Aug 3 13:14:09 2022] POST /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 13:14:09.525655 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-6b6f8428-16e5-44b2-8a4e-489bfed7d0ec tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:09.526468 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-6b6f8428-16e5-44b2-8a4e-489bfed7d0ec tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:09.534208 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6b6f8428-16e5-44b2-8a4e-489bfed7d0ec tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:09.534761 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6b6f8428-16e5-44b2-8a4e-489bfed7d0ec tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:09.535553 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6b6f8428-16e5-44b2-8a4e-489bfed7d0ec tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:09.536244 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6b6f8428-16e5-44b2-8a4e-489bfed7d0ec tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:09.673558 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-6b6f8428-16e5-44b2-8a4e-489bfed7d0ec tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:14:09.682614 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-6b6f8428-16e5-44b2-8a4e-489bfed7d0ec tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1709 microversion: 2.1 time: 0.160658 Aug 03 13:14:09.683972 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 592/1189] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:14:09 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1709 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:14:09.772018 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-9f17ce14-28e7-4e66-b7d3-ba547402347b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:09.772811 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-9f17ce14-28e7-4e66-b7d3-ba547402347b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: eeb53552-b05d-4931-920f-b11bac28243b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:09.779308 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9f17ce14-28e7-4e66-b7d3-ba547402347b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:09.779852 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9f17ce14-28e7-4e66-b7d3-ba547402347b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:09.780694 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9f17ce14-28e7-4e66-b7d3-ba547402347b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:09.781202 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-9f17ce14-28e7-4e66-b7d3-ba547402347b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:09.918525 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-9f17ce14-28e7-4e66-b7d3-ba547402347b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:14:09.926659 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-9f17ce14-28e7-4e66-b7d3-ba547402347b tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b" status: 200 len: 1458 microversion: 2.1 time: 0.159196 Aug 03 13:14:09.927267 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 598/1190] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:14:09 2022] GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b => generated 1458 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:14:10.586511 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-d4111c10-abea-49f7-a9e7-2725d2ab0cf0 req-c69d78f0-5824-42e3-a379-5c85b0e43506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb53552-b05d-4931-920f-b11bac28243b", "name": "network-vif-deleted", "tag": "1db7a902-7951-431f-9eb7-e35311be4427"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:14:10.598282 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-d4111c10-abea-49f7-a9e7-2725d2ab0cf0 req-c69d78f0-5824-42e3-a379-5c85b0e43506 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:10.598780 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-d4111c10-abea-49f7-a9e7-2725d2ab0cf0 req-c69d78f0-5824-42e3-a379-5c85b0e43506 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:10.613937 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-d4111c10-abea-49f7-a9e7-2725d2ab0cf0 req-c69d78f0-5824-42e3-a379-5c85b0e43506 service nova] Creating event network-vif-deleted:1db7a902-7951-431f-9eb7-e35311be4427 for instance eeb53552-b05d-4931-920f-b11bac28243b on hv-cinder-85083 Aug 03 13:14:10.618188 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-d4111c10-abea-49f7-a9e7-2725d2ab0cf0 req-c69d78f0-5824-42e3-a379-5c85b0e43506 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037840 Aug 03 13:14:10.620388 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 593/1191] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:14:10.706557 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-6919e228-5d5b-4e8a-ac66-e9a41151d07b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:10.707195 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-6919e228-5d5b-4e8a-ac66-e9a41151d07b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:10.713225 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6919e228-5d5b-4e8a-ac66-e9a41151d07b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:10.713674 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6919e228-5d5b-4e8a-ac66-e9a41151d07b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:10.714438 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6919e228-5d5b-4e8a-ac66-e9a41151d07b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:10.715507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6919e228-5d5b-4e8a-ac66-e9a41151d07b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:10.849073 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-6919e228-5d5b-4e8a-ac66-e9a41151d07b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:14:10.857512 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-6919e228-5d5b-4e8a-ac66-e9a41151d07b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1709 microversion: 2.1 time: 0.157120 Aug 03 13:14:10.858097 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 599/1192] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:14:10 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1709 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:14:10.949712 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e4dc214d-06f5-4e40-aa26-bc90218471d1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:10.950718 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-e4dc214d-06f5-4e40-aa26-bc90218471d1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: eeb53552-b05d-4931-920f-b11bac28243b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:10.957186 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e4dc214d-06f5-4e40-aa26-bc90218471d1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:10.962589 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e4dc214d-06f5-4e40-aa26-bc90218471d1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:10.962589 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e4dc214d-06f5-4e40-aa26-bc90218471d1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:10.962589 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e4dc214d-06f5-4e40-aa26-bc90218471d1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:11.023065 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-e4dc214d-06f5-4e40-aa26-bc90218471d1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:14:11.030683 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-e4dc214d-06f5-4e40-aa26-bc90218471d1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b" status: 200 len: 1225 microversion: 2.1 time: 0.085982 Aug 03 13:14:11.031278 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 594/1193] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:14:10 2022] GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:14:11.879672 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ab02aaff-58a5-483a-9db7-cfcad373fb02 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:11.880291 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-ab02aaff-58a5-483a-9db7-cfcad373fb02 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:11.886749 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ab02aaff-58a5-483a-9db7-cfcad373fb02 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:11.887207 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ab02aaff-58a5-483a-9db7-cfcad373fb02 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:11.887973 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ab02aaff-58a5-483a-9db7-cfcad373fb02 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:11.888412 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ab02aaff-58a5-483a-9db7-cfcad373fb02 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:12.020407 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ab02aaff-58a5-483a-9db7-cfcad373fb02 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:14:12.028898 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-ab02aaff-58a5-483a-9db7-cfcad373fb02 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1709 microversion: 2.1 time: 0.153123 Aug 03 13:14:12.029505 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 600/1194] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:14:11 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1709 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:14:12.051325 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-ddcf3f05-206d-4721-9133-e77c984957b1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:12.051903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-ddcf3f05-206d-4721-9133-e77c984957b1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: eeb53552-b05d-4931-920f-b11bac28243b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:12.058398 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ddcf3f05-206d-4721-9133-e77c984957b1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:12.058891 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ddcf3f05-206d-4721-9133-e77c984957b1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:12.059652 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ddcf3f05-206d-4721-9133-e77c984957b1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:12.060090 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ddcf3f05-206d-4721-9133-e77c984957b1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:12.095572 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ddcf3f05-206d-4721-9133-e77c984957b1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:12.096016 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ddcf3f05-206d-4721-9133-e77c984957b1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:12.096454 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-ddcf3f05-206d-4721-9133-e77c984957b1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lazy-loading 'fault' on Instance uuid eeb53552-b05d-4931-920f-b11bac28243b {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:14:12.137932 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ddcf3f05-206d-4721-9133-e77c984957b1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ccafac03aa420db7f76165f20b0d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c182a81a1c64866944f21c4e26725a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:14:12.145868 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-ddcf3f05-206d-4721-9133-e77c984957b1 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b" status: 200 len: 1230 microversion: 2.1 time: 0.098353 Aug 03 13:14:12.147340 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 595/1195] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:14:12 2022] GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:14:13.050047 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-43bf8405-38bb-4a99-8b48-e2a3810e08a8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:13.050661 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-43bf8405-38bb-4a99-8b48-e2a3810e08a8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:13.053083 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=39 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:14:13.057752 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-43bf8405-38bb-4a99-8b48-e2a3810e08a8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:13.058696 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-43bf8405-38bb-4a99-8b48-e2a3810e08a8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:13.059476 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-43bf8405-38bb-4a99-8b48-e2a3810e08a8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:13.059906 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-43bf8405-38bb-4a99-8b48-e2a3810e08a8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:13.166988 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-0a98845f-d954-4721-b6d0-139163980d68 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:13.167608 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-0a98845f-d954-4721-b6d0-139163980d68 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: eeb53552-b05d-4931-920f-b11bac28243b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:13.174064 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0a98845f-d954-4721-b6d0-139163980d68 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:13.174517 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0a98845f-d954-4721-b6d0-139163980d68 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:13.175312 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0a98845f-d954-4721-b6d0-139163980d68 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:13.175753 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-0a98845f-d954-4721-b6d0-139163980d68 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:13.189710 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.wsgi [None req-0a98845f-d954-4721-b6d0-139163980d68 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] HTTP exception thrown: Instance eeb53552-b05d-4931-920f-b11bac28243b could not be found. Aug 03 13:14:13.191372 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-0a98845f-d954-4721-b6d0-139163980d68 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Request method failure captured: Aug 03 13:14:13.191372 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: request: GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b HTTP/1.1 Aug 03 13:14:13.191372 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept: application/json Aug 03 13:14:13.191372 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept-Encoding: identity Aug 03 13:14:13.191372 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Connection: close Aug 03 13:14:13.191372 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Length: 0 Aug 03 13:14:13.191372 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Type: application/json Aug 03 13:14:13.191372 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Host: 10.222.0.64 Aug 03 13:14:13.191372 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Openstack-System-Scope: None Aug 03 13:14:13.191372 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: User-Agent: python-urllib3/1.26.10 Aug 03 13:14:13.191372 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Auth-Token: gAAAAABi6nJ4BMxiM3qOr4MBFgilu-HzP9w6Z0P34I4SNv2Ei8q1YsRoFkVbCX-CvQirWaj_9sEHyPAtRXsB2UKF1AHES1D2CvG2OJdZd9TSXlKZyV7szIwANnyCCoTbAruFt5o_V3UrZ-qqMbnA3qqopgm-vDSnazYl4r9GPCsWSdilHdFD8iM Aug 03 13:14:13.191372 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Id: None Aug 03 13:14:13.191372 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Name: None Aug 03 13:14:13.191372 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Identity-Status: Confirmed Aug 03 13:14:13.191372 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Is-Admin-Project: True Aug 03 13:14:13.191372 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Id: default Aug 03 13:14:13.191372 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Name: Default Aug 03 13:14:13.191372 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Id: 5c182a81a1c64866944f21c4e26725a3 Aug 03 13:14:13.191372 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Name: tempest-TestVolumeBootPattern-62569797 Aug 03 13:14:13.191372 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Role: member,reader Aug 03 13:14:13.191372 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Roles: member,reader Aug 03 13:14:13.192961 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5c182a81a1c64866944f21c4e26725a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5c182a81a1c64866944f21c4e26725a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5c182a81a1c64866944f21c4e26725a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5c182a81a1c64866944f21c4e26725a3", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:14:13.192961 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant: tempest-TestVolumeBootPattern-62569797 Aug 03 13:14:13.192961 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Id: 5c182a81a1c64866944f21c4e26725a3 Aug 03 13:14:13.192961 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Name: tempest-TestVolumeBootPattern-62569797 Aug 03 13:14:13.192961 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User: tempest-TestVolumeBootPattern-62569797-project Aug 03 13:14:13.192961 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Id: default Aug 03 13:14:13.192961 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Name: Default Aug 03 13:14:13.192961 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Id: b2ccafac03aa420db7f76165f20b0d3b Aug 03 13:14:13.192961 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Name: tempest-TestVolumeBootPattern-62569797-project Aug 03 13:14:13.192961 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: method: > Aug 03 13:14:13.192961 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: exception: Instance eeb53552-b05d-4931-920f-b11bac28243b could not be found. Aug 03 13:14:13.192961 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: action_args: {'id': 'eeb53552-b05d-4931-920f-b11bac28243b'} Aug 03 13:14:13.194582 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:14:13.194582 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:14:13.194582 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:14:13.194582 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:14:13.194582 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:14:13.194582 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:14:13.194582 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:14:13.194582 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:14:13.194582 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:14:13.194582 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:14:13.194582 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeb53552-b05d-4931-920f-b11bac28243b could not be found. Aug 03 13:14:13.194582 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:14:13.194582 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:14:13.194582 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:14:13.194582 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:14:13.194582 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:14:13.194582 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:14:13.194582 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:14:13.194582 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:14:13.194582 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:14:13.195979 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:14:13.195979 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:14:13.195979 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:14:13.195979 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:14:13.195979 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:14:13.195979 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:14:13.195979 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:14:13.195979 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeb53552-b05d-4931-920f-b11bac28243b could not be found. Aug 03 13:14:13.195979 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:14:13.195979 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:14:13.195979 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:14:13.195979 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:14:13.195979 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:14:13.195979 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:14:13.195979 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:14:13.195979 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:14:13.195979 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeb53552-b05d-4931-920f-b11bac28243b could not be found. Aug 03 13:14:13.195979 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:14:13.197325 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-43bf8405-38bb-4a99-8b48-e2a3810e08a8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:14:13.197902 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-0a98845f-d954-4721-b6d0-139163980d68 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Returning 404 to user: Instance eeb53552-b05d-4931-920f-b11bac28243b could not be found. {{(pid=119410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:14:13.197902 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-0a98845f-d954-4721-b6d0-139163980d68 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b" status: 404 len: 111 microversion: 2.1 time: 0.029713 Aug 03 13:14:13.197902 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 596/1196] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:14:13 2022] GET /compute/v2.1/servers/eeb53552-b05d-4931-920f-b11bac28243b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 13:14:13.200661 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-43bf8405-38bb-4a99-8b48-e2a3810e08a8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1713 microversion: 2.1 time: 0.154460 Aug 03 13:14:13.201234 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 601/1197] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:14:13 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1713 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:14:13.716220 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d85f9a63-962b-4d4e-9b4d-36565acd29c8 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:13.716722 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d85f9a63-962b-4d4e-9b4d-36565acd29c8 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:13.722723 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d85f9a63-962b-4d4e-9b4d-36565acd29c8 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:13.723210 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d85f9a63-962b-4d4e-9b4d-36565acd29c8 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:13.723969 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d85f9a63-962b-4d4e-9b4d-36565acd29c8 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:13.724404 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d85f9a63-962b-4d4e-9b4d-36565acd29c8 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:13.737964 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.wsgi [None req-d85f9a63-962b-4d4e-9b4d-36565acd29c8 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] HTTP exception thrown: Instance b9d598c3-1b65-4871-b23f-ffb42f3551aa could not be found. Aug 03 13:14:13.739508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d85f9a63-962b-4d4e-9b4d-36565acd29c8 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Request method failure captured: Aug 03 13:14:13.739508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: request: DELETE /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa HTTP/1.1 Aug 03 13:14:13.739508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept: application/json Aug 03 13:14:13.739508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept-Encoding: identity Aug 03 13:14:13.739508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Connection: close Aug 03 13:14:13.739508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Length: 0 Aug 03 13:14:13.739508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Type: application/json Aug 03 13:14:13.739508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Host: 10.222.0.64 Aug 03 13:14:13.739508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Openstack-System-Scope: None Aug 03 13:14:13.739508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: User-Agent: python-urllib3/1.26.10 Aug 03 13:14:13.739508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Auth-Token: gAAAAABi6nJ4BMxiM3qOr4MBFgilu-HzP9w6Z0P34I4SNv2Ei8q1YsRoFkVbCX-CvQirWaj_9sEHyPAtRXsB2UKF1AHES1D2CvG2OJdZd9TSXlKZyV7szIwANnyCCoTbAruFt5o_V3UrZ-qqMbnA3qqopgm-vDSnazYl4r9GPCsWSdilHdFD8iM Aug 03 13:14:13.739508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Id: None Aug 03 13:14:13.739508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Name: None Aug 03 13:14:13.739508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Identity-Status: Confirmed Aug 03 13:14:13.739508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Is-Admin-Project: True Aug 03 13:14:13.739508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Id: default Aug 03 13:14:13.739508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Name: Default Aug 03 13:14:13.739508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Id: 5c182a81a1c64866944f21c4e26725a3 Aug 03 13:14:13.739508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Name: tempest-TestVolumeBootPattern-62569797 Aug 03 13:14:13.739508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Role: member,reader Aug 03 13:14:13.739508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Roles: member,reader Aug 03 13:14:13.741090 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5c182a81a1c64866944f21c4e26725a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5c182a81a1c64866944f21c4e26725a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5c182a81a1c64866944f21c4e26725a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5c182a81a1c64866944f21c4e26725a3", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:14:13.741090 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant: tempest-TestVolumeBootPattern-62569797 Aug 03 13:14:13.741090 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Id: 5c182a81a1c64866944f21c4e26725a3 Aug 03 13:14:13.741090 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Name: tempest-TestVolumeBootPattern-62569797 Aug 03 13:14:13.741090 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User: tempest-TestVolumeBootPattern-62569797-project Aug 03 13:14:13.741090 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Id: default Aug 03 13:14:13.741090 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Name: Default Aug 03 13:14:13.741090 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Id: b2ccafac03aa420db7f76165f20b0d3b Aug 03 13:14:13.741090 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Name: tempest-TestVolumeBootPattern-62569797-project Aug 03 13:14:13.741090 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: method: > Aug 03 13:14:13.741090 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: exception: Instance b9d598c3-1b65-4871-b23f-ffb42f3551aa could not be found. Aug 03 13:14:13.741090 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: action_args: {'id': 'b9d598c3-1b65-4871-b23f-ffb42f3551aa'} Aug 03 13:14:13.741940 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:14:13.741940 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:14:13.741940 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:14:13.741940 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:14:13.741940 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:14:13.741940 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:14:13.741940 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:14:13.741940 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:14:13.741940 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:14:13.741940 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:14:13.741940 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9d598c3-1b65-4871-b23f-ffb42f3551aa could not be found. Aug 03 13:14:13.741940 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:14:13.741940 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:14:13.741940 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:14:13.741940 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:14:13.741940 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:14:13.741940 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:14:13.741940 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:14:13.741940 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:14:13.741940 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:14:13.743238 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:14:13.743238 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 13:14:13.743238 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 13:14:13.743238 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 13:14:13.743238 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 13:14:13.743238 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:14:13.743238 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:14:13.743238 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:14:13.743238 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:14:13.743238 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9d598c3-1b65-4871-b23f-ffb42f3551aa could not be found. Aug 03 13:14:13.743238 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:14:13.743238 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:14:13.743238 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:14:13.743238 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:14:13.743238 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:14:13.743238 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:14:13.743238 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:14:13.743238 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:14:13.743238 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9d598c3-1b65-4871-b23f-ffb42f3551aa could not be found. Aug 03 13:14:13.743238 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:14:13.744466 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d85f9a63-962b-4d4e-9b4d-36565acd29c8 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Returning 404 to user: Instance b9d598c3-1b65-4871-b23f-ffb42f3551aa could not be found. {{(pid=119410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:14:13.744466 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d85f9a63-962b-4d4e-9b4d-36565acd29c8 tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "DELETE /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 404 len: 111 microversion: 2.1 time: 0.028654 Aug 03 13:14:13.744466 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 597/1198] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 3 13:14:13 2022] DELETE /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:14:13.750007 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-52cc161e-7a94-4b29-bc92-7307153a03fd tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:13.750620 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-52cc161e-7a94-4b29-bc92-7307153a03fd tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [instance: b9d598c3-1b65-4871-b23f-ffb42f3551aa] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:13.756631 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-52cc161e-7a94-4b29-bc92-7307153a03fd tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:13.757082 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-52cc161e-7a94-4b29-bc92-7307153a03fd tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:13.757845 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-52cc161e-7a94-4b29-bc92-7307153a03fd tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:13.758280 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-52cc161e-7a94-4b29-bc92-7307153a03fd tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:13.774109 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-52cc161e-7a94-4b29-bc92-7307153a03fd tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] HTTP exception thrown: Instance b9d598c3-1b65-4871-b23f-ffb42f3551aa could not be found. Aug 03 13:14:13.775745 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-52cc161e-7a94-4b29-bc92-7307153a03fd tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Request method failure captured: Aug 03 13:14:13.775745 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa HTTP/1.1 Aug 03 13:14:13.775745 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 13:14:13.775745 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 13:14:13.775745 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 13:14:13.775745 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 0 Aug 03 13:14:13.775745 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 13:14:13.775745 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 13:14:13.775745 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 13:14:13.775745 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 13:14:13.775745 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nJ4BMxiM3qOr4MBFgilu-HzP9w6Z0P34I4SNv2Ei8q1YsRoFkVbCX-CvQirWaj_9sEHyPAtRXsB2UKF1AHES1D2CvG2OJdZd9TSXlKZyV7szIwANnyCCoTbAruFt5o_V3UrZ-qqMbnA3qqopgm-vDSnazYl4r9GPCsWSdilHdFD8iM Aug 03 13:14:13.775745 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 13:14:13.775745 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 13:14:13.775745 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 13:14:13.775745 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 13:14:13.775745 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 13:14:13.775745 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 13:14:13.775745 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: 5c182a81a1c64866944f21c4e26725a3 Aug 03 13:14:13.775745 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-TestVolumeBootPattern-62569797 Aug 03 13:14:13.775745 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 13:14:13.775745 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 13:14:13.777918 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5c182a81a1c64866944f21c4e26725a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5c182a81a1c64866944f21c4e26725a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5c182a81a1c64866944f21c4e26725a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5c182a81a1c64866944f21c4e26725a3", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:14:13.777918 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-TestVolumeBootPattern-62569797 Aug 03 13:14:13.777918 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: 5c182a81a1c64866944f21c4e26725a3 Aug 03 13:14:13.777918 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-TestVolumeBootPattern-62569797 Aug 03 13:14:13.777918 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-TestVolumeBootPattern-62569797-project Aug 03 13:14:13.777918 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 13:14:13.777918 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 13:14:13.777918 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: b2ccafac03aa420db7f76165f20b0d3b Aug 03 13:14:13.777918 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-TestVolumeBootPattern-62569797-project Aug 03 13:14:13.777918 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: > Aug 03 13:14:13.777918 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Instance b9d598c3-1b65-4871-b23f-ffb42f3551aa could not be found. Aug 03 13:14:13.777918 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'id': 'b9d598c3-1b65-4871-b23f-ffb42f3551aa'} Aug 03 13:14:13.778827 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:14:13.778827 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:14:13.778827 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:14:13.778827 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:14:13.778827 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:14:13.778827 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:14:13.778827 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:14:13.778827 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:14:13.778827 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:14:13.778827 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:14:13.778827 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9d598c3-1b65-4871-b23f-ffb42f3551aa could not be found. Aug 03 13:14:13.778827 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:14:13.778827 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:14:13.778827 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:14:13.778827 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:14:13.778827 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:14:13.778827 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:14:13.778827 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:14:13.778827 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:14:13.778827 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:14:13.780332 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:14:13.780332 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:14:13.780332 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:14:13.780332 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:14:13.780332 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:14:13.780332 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:14:13.780332 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:14:13.780332 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9d598c3-1b65-4871-b23f-ffb42f3551aa could not be found. Aug 03 13:14:13.780332 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:14:13.780332 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:14:13.780332 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:14:13.780332 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:14:13.780332 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:14:13.780332 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:14:13.780332 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:14:13.780332 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:14:13.780332 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9d598c3-1b65-4871-b23f-ffb42f3551aa could not be found. Aug 03 13:14:13.780332 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:14:13.781672 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-52cc161e-7a94-4b29-bc92-7307153a03fd tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Returning 404 to user: Instance b9d598c3-1b65-4871-b23f-ffb42f3551aa could not be found. {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:14:13.781672 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-52cc161e-7a94-4b29-bc92-7307153a03fd tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa" status: 404 len: 111 microversion: 2.1 time: 0.031534 Aug 03 13:14:13.781672 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 602/1199] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:14:13 2022] GET /compute/v2.1/servers/b9d598c3-1b65-4871-b23f-ffb42f3551aa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 13:14:15.222790 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-97429fed-e227-427a-9b99-e3078036292c tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] Calling method '.version_select at 0x7fe6d8ad6550>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:15.228986 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR oslo.messaging._drivers.impl_rabbit [None req-97429fed-e227-427a-9b99-e3078036292c tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [631f554a-c21b-4312-b419-e75c9d73acb3] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 13:14:16.237162 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO oslo.messaging._drivers.impl_rabbit [None req-97429fed-e227-427a-9b99-e3078036292c tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] [631f554a-c21b-4312-b419-e75c9d73acb3] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 42314. Aug 03 13:14:16.331846 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-97429fed-e227-427a-9b99-e3078036292c tempest-TestVolumeBootPattern-62569797 tempest-TestVolumeBootPattern-62569797-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-285932187" status: 202 len: 0 microversion: 2.1 time: 1.113601 Aug 03 13:14:16.332430 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 598/1200] 10.222.0.64 () {58 vars in 1260 bytes} [Wed Aug 3 13:14:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-285932187 => generated 0 bytes in 1115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 13:14:41.039527 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 13:14:41.040118 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Wed Aug 3 13:14:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 13:14:50.926961 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=28 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:14:50.930969 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ff529acb-df9b-4384-a745-0935c38c8004 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:50.930969 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-ff529acb-df9b-4384-a745-0935c38c8004 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:50.931518 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:14:50.931679 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=3 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:14:50.933052 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=27,nova_cell1:INSERT=1 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:14:50.934502 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-47d9c342-02ad-45ec-aab0-37f6d9e6db24 req-0d5eb728-eb25-4707-960c-83faa72c46f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1370967-b0b8-4afe-99a9-142716f118bb", "tag": "12ced69b-7cb0-4bac-a7d5-0b77dc4d6f10"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:14:50.936895 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ff529acb-df9b-4384-a745-0935c38c8004 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:50.937417 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ff529acb-df9b-4384-a745-0935c38c8004 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:50.938259 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ff529acb-df9b-4384-a745-0935c38c8004 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:50.939182 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ff529acb-df9b-4384-a745-0935c38c8004 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:50.943949 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-47d9c342-02ad-45ec-aab0-37f6d9e6db24 req-0d5eb728-eb25-4707-960c-83faa72c46f5 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:50.944367 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-47d9c342-02ad-45ec-aab0-37f6d9e6db24 req-0d5eb728-eb25-4707-960c-83faa72c46f5 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:50.956478 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-47d9c342-02ad-45ec-aab0-37f6d9e6db24 req-0d5eb728-eb25-4707-960c-83faa72c46f5 service nova] Creating event network-changed:12ced69b-7cb0-4bac-a7d5-0b77dc4d6f10 for instance b1370967-b0b8-4afe-99a9-142716f118bb on hv-cinder-85083 Aug 03 13:14:50.962619 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-47d9c342-02ad-45ec-aab0-37f6d9e6db24 req-0d5eb728-eb25-4707-960c-83faa72c46f5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037000 Aug 03 13:14:50.968571 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 599/1201] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:14:50.969119 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-ff529acb-df9b-4384-a745-0935c38c8004 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Going to try to terminate instance {{(pid=119409) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 13:14:51.289929 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-ff529acb-df9b-4384-a745-0935c38c8004 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "DELETE /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 204 len: 0 microversion: 2.1 time: 0.366016 Aug 03 13:14:51.290624 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 603/1202] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 3 13:14:50 2022] DELETE /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 13:14:51.299731 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-21dcd446-584a-42fe-ac2c-d7dcef3bea85 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:51.301062 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-21dcd446-584a-42fe-ac2c-d7dcef3bea85 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:51.310125 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-21dcd446-584a-42fe-ac2c-d7dcef3bea85 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:51.310657 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-21dcd446-584a-42fe-ac2c-d7dcef3bea85 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:51.311538 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-21dcd446-584a-42fe-ac2c-d7dcef3bea85 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:51.312049 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-21dcd446-584a-42fe-ac2c-d7dcef3bea85 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:51.563081 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-21dcd446-584a-42fe-ac2c-d7dcef3bea85 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:14:51.568514 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-21dcd446-584a-42fe-ac2c-d7dcef3bea85 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1569 microversion: 2.1 time: 0.272975 Aug 03 13:14:51.569088 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 600/1203] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:14:51 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1569 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:14:52.590309 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-3419274d-823c-46f9-90d4-c876ab70c38c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:52.591904 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-3419274d-823c-46f9-90d4-c876ab70c38c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:52.599225 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3419274d-823c-46f9-90d4-c876ab70c38c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:52.599670 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3419274d-823c-46f9-90d4-c876ab70c38c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:52.600441 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3419274d-823c-46f9-90d4-c876ab70c38c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:52.601108 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3419274d-823c-46f9-90d4-c876ab70c38c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:52.787737 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-3419274d-823c-46f9-90d4-c876ab70c38c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:14:52.795773 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-3419274d-823c-46f9-90d4-c876ab70c38c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1569 microversion: 2.1 time: 0.209781 Aug 03 13:14:52.796437 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 604/1204] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:14:52 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1569 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:14:53.732598 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-b269c103-b605-4cbe-8f6c-38589a702176 req-c19cbc5a-5c06-46fd-8c6f-c94cd1820a3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1370967-b0b8-4afe-99a9-142716f118bb", "name": "network-vif-deleted", "tag": "12ced69b-7cb0-4bac-a7d5-0b77dc4d6f10"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:14:53.742780 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-b269c103-b605-4cbe-8f6c-38589a702176 req-c19cbc5a-5c06-46fd-8c6f-c94cd1820a3a service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:53.743218 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-b269c103-b605-4cbe-8f6c-38589a702176 req-c19cbc5a-5c06-46fd-8c6f-c94cd1820a3a service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:53.754013 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-b269c103-b605-4cbe-8f6c-38589a702176 req-c19cbc5a-5c06-46fd-8c6f-c94cd1820a3a service nova] Creating event network-vif-deleted:12ced69b-7cb0-4bac-a7d5-0b77dc4d6f10 for instance b1370967-b0b8-4afe-99a9-142716f118bb on hv-cinder-85083 Aug 03 13:14:53.759101 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-b269c103-b605-4cbe-8f6c-38589a702176 req-c19cbc5a-5c06-46fd-8c6f-c94cd1820a3a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030183 Aug 03 13:14:53.759720 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 601/1205] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:14:53.817397 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-6da51e64-0d02-4f98-8b9b-3e1576f89ae0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:53.818093 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-6da51e64-0d02-4f98-8b9b-3e1576f89ae0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:53.825208 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6da51e64-0d02-4f98-8b9b-3e1576f89ae0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:53.825665 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6da51e64-0d02-4f98-8b9b-3e1576f89ae0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:53.826429 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6da51e64-0d02-4f98-8b9b-3e1576f89ae0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:53.827070 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6da51e64-0d02-4f98-8b9b-3e1576f89ae0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:53.888363 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-6da51e64-0d02-4f98-8b9b-3e1576f89ae0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:14:53.895844 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-6da51e64-0d02-4f98-8b9b-3e1576f89ae0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1382 microversion: 2.1 time: 0.082276 Aug 03 13:14:53.896402 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 605/1206] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:14:53 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1382 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:14:54.917744 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d6860739-4736-485a-a94a-1aaa4e7a4fc0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:54.918442 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d6860739-4736-485a-a94a-1aaa4e7a4fc0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:54.925176 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d6860739-4736-485a-a94a-1aaa4e7a4fc0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:54.925632 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d6860739-4736-485a-a94a-1aaa4e7a4fc0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:54.926498 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d6860739-4736-485a-a94a-1aaa4e7a4fc0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:54.926966 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d6860739-4736-485a-a94a-1aaa4e7a4fc0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:54.959159 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d6860739-4736-485a-a94a-1aaa4e7a4fc0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:54.959626 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d6860739-4736-485a-a94a-1aaa4e7a4fc0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:54.960508 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-d6860739-4736-485a-a94a-1aaa4e7a4fc0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lazy-loading 'fault' on Instance uuid b1370967-b0b8-4afe-99a9-142716f118bb {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:14:55.000944 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d6860739-4736-485a-a94a-1aaa4e7a4fc0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5094778e88de495d96981c16da9ee916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0b838da49141f99cb5073f13024892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:14:55.008422 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d6860739-4736-485a-a94a-1aaa4e7a4fc0 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 200 len: 1224 microversion: 2.1 time: 0.094852 Aug 03 13:14:55.008991 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 602/1207] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:14:54 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:14:56.030449 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-6e11bc0c-0a51-4d9c-a5e6-f4cbd614723c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:56.031086 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-6e11bc0c-0a51-4d9c-a5e6-f4cbd614723c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] [instance: b1370967-b0b8-4afe-99a9-142716f118bb] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:14:56.038127 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6e11bc0c-0a51-4d9c-a5e6-f4cbd614723c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:56.038579 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6e11bc0c-0a51-4d9c-a5e6-f4cbd614723c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:56.039388 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6e11bc0c-0a51-4d9c-a5e6-f4cbd614723c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:14:56.039832 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6e11bc0c-0a51-4d9c-a5e6-f4cbd614723c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:14:56.053200 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-6e11bc0c-0a51-4d9c-a5e6-f4cbd614723c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] HTTP exception thrown: Instance b1370967-b0b8-4afe-99a9-142716f118bb could not be found. Aug 03 13:14:56.054855 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-6e11bc0c-0a51-4d9c-a5e6-f4cbd614723c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Request method failure captured: Aug 03 13:14:56.054855 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb HTTP/1.1 Aug 03 13:14:56.054855 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 13:14:56.054855 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 13:14:56.054855 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 13:14:56.054855 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 0 Aug 03 13:14:56.054855 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 13:14:56.054855 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 13:14:56.054855 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 13:14:56.054855 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 13:14:56.054855 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nNwW5_avbUveLcagfL5XwJcoOAxWm6MoLW4hpCKkPSOGVKhshEVKsRFfd4vIdJBURKcbqDIo3cOo6r8GT_9NHFGF2ZunfmMLySP7C94yAHV6NRB-3nYjSL9sYHg54epn8auVU9RFHtWa1fT389K0gyYBqC1-DW5yViVO91Fg6DK0tU Aug 03 13:14:56.054855 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 13:14:56.054855 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 13:14:56.054855 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 13:14:56.054855 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 13:14:56.054855 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 13:14:56.054855 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 13:14:56.054855 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: 8d0b838da49141f99cb5073f13024892 Aug 03 13:14:56.054855 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-TestShelveInstance-1974752117 Aug 03 13:14:56.054855 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 13:14:56.054855 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 13:14:56.056379 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8d0b838da49141f99cb5073f13024892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8d0b838da49141f99cb5073f13024892"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8d0b838da49141f99cb5073f13024892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8d0b838da49141f99cb5073f13024892", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:14:56.056379 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-TestShelveInstance-1974752117 Aug 03 13:14:56.056379 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: 8d0b838da49141f99cb5073f13024892 Aug 03 13:14:56.056379 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-TestShelveInstance-1974752117 Aug 03 13:14:56.056379 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-TestShelveInstance-1974752117-project Aug 03 13:14:56.056379 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 13:14:56.056379 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 13:14:56.056379 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: 5094778e88de495d96981c16da9ee916 Aug 03 13:14:56.056379 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-TestShelveInstance-1974752117-project Aug 03 13:14:56.056379 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: > Aug 03 13:14:56.056379 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Instance b1370967-b0b8-4afe-99a9-142716f118bb could not be found. Aug 03 13:14:56.056379 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'id': 'b1370967-b0b8-4afe-99a9-142716f118bb'} Aug 03 13:14:56.057265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:14:56.057265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:14:56.057265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:14:56.057265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:14:56.057265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:14:56.057265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:14:56.057265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:14:56.057265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:14:56.057265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:14:56.057265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:14:56.057265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1370967-b0b8-4afe-99a9-142716f118bb could not be found. Aug 03 13:14:56.057265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:14:56.057265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:14:56.057265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:14:56.057265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:14:56.057265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:14:56.057265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:14:56.057265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:14:56.057265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:14:56.057265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:14:56.058874 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:14:56.058874 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:14:56.058874 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:14:56.058874 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:14:56.058874 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:14:56.058874 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:14:56.058874 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:14:56.058874 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1370967-b0b8-4afe-99a9-142716f118bb could not be found. Aug 03 13:14:56.058874 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:14:56.058874 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:14:56.058874 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:14:56.058874 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:14:56.058874 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:14:56.058874 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:14:56.058874 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:14:56.058874 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:14:56.058874 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1370967-b0b8-4afe-99a9-142716f118bb could not be found. Aug 03 13:14:56.058874 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:14:56.060253 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-6e11bc0c-0a51-4d9c-a5e6-f4cbd614723c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Returning 404 to user: Instance b1370967-b0b8-4afe-99a9-142716f118bb could not be found. {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:14:56.060253 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-6e11bc0c-0a51-4d9c-a5e6-f4cbd614723c tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb" status: 404 len: 111 microversion: 2.1 time: 0.030263 Aug 03 13:14:56.060253 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 606/1208] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:14:56 2022] GET /compute/v2.1/servers/b1370967-b0b8-4afe-99a9-142716f118bb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:14:56.294610 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-5e0086d8-3e47-4d86-8fa6-ec7d744b3b26 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] Calling method '.version_select at 0x7fe6d80ddf70>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:14:56.371760 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-5e0086d8-3e47-4d86-8fa6-ec7d744b3b26 tempest-TestShelveInstance-1974752117 tempest-TestShelveInstance-1974752117-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1280873694" status: 202 len: 0 microversion: 2.1 time: 0.080980 Aug 03 13:14:56.372371 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 603/1209] 10.222.0.64 () {58 vars in 1254 bytes} [Wed Aug 3 13:14:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1280873694 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 13:15:08.645118 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-4962f93d-f487-43fc-9036-7d550204241d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:15:08.645723 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-4962f93d-f487-43fc-9036-7d550204241d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:15:08.648248 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:15:08.649050 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:15:08.654277 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4962f93d-f487-43fc-9036-7d550204241d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:08.654723 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4962f93d-f487-43fc-9036-7d550204241d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:08.655506 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4962f93d-f487-43fc-9036-7d550204241d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:08.655940 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4962f93d-f487-43fc-9036-7d550204241d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:08.735805 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.objects.instance [None req-4962f93d-f487-43fc-9036-7d550204241d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lazy-loading 'services' on Instance uuid 327747f6-507a-42b7-a7bc-56b2947b0d25 {{(pid=119409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:15:08.979927 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-4962f93d-f487-43fc-9036-7d550204241d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "DELETE /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25/os-volume_attachments/fab359d8-f830-4696-a5a6-1ef981ec6767" status: 202 len: 0 microversion: 2.1 time: 0.338577 Aug 03 13:15:08.980558 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 607/1210] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Aug 3 13:15:08 2022] DELETE /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25/os-volume_attachments/fab359d8-f830-4696-a5a6-1ef981ec6767 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 13:15:10.096156 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=18 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:15:10.096906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:15:10.100816 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1c213447-0e00-4bad-a34f-699f374a7b8a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:15:10.107334 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1c213447-0e00-4bad-a34f-699f374a7b8a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:10.107788 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1c213447-0e00-4bad-a34f-699f374a7b8a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:10.129798 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-1c213447-0e00-4bad-a34f-699f374a7b8a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Going to try to stop instance {{(pid=119410) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 13:15:10.298166 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-1c213447-0e00-4bad-a34f-699f374a7b8a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "POST /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25/action" status: 202 len: 0 microversion: 2.1 time: 0.203259 Aug 03 13:15:10.298679 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 604/1211] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Aug 3 13:15:10 2022] POST /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 13:15:10.307916 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-bad98b8a-04c3-4d02-8ce6-3d36004f128f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:15:10.308617 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-bad98b8a-04c3-4d02-8ce6-3d36004f128f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:15:10.315178 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bad98b8a-04c3-4d02-8ce6-3d36004f128f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:10.315690 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bad98b8a-04c3-4d02-8ce6-3d36004f128f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:10.316464 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bad98b8a-04c3-4d02-8ce6-3d36004f128f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:10.316904 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bad98b8a-04c3-4d02-8ce6-3d36004f128f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:10.450681 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-bad98b8a-04c3-4d02-8ce6-3d36004f128f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:15:10.459726 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-bad98b8a-04c3-4d02-8ce6-3d36004f128f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1677 microversion: 2.1 time: 0.156512 Aug 03 13:15:10.460290 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 608/1212] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:15:10 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:15:11.483453 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-9709bebf-2544-4910-a1ce-732b3a4c1760 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:15:11.484146 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-9709bebf-2544-4910-a1ce-732b3a4c1760 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:15:11.490369 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9709bebf-2544-4910-a1ce-732b3a4c1760 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:11.490860 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9709bebf-2544-4910-a1ce-732b3a4c1760 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:11.491614 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9709bebf-2544-4910-a1ce-732b3a4c1760 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:11.492041 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9709bebf-2544-4910-a1ce-732b3a4c1760 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:11.622331 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-9709bebf-2544-4910-a1ce-732b3a4c1760 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:15:11.629716 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-9709bebf-2544-4910-a1ce-732b3a4c1760 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1677 microversion: 2.1 time: 0.151638 Aug 03 13:15:11.630352 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 605/1213] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:15:11 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:15:12.651641 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-f8400de7-18f6-43f9-a899-33b7c51a0e54 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:15:12.652314 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-f8400de7-18f6-43f9-a899-33b7c51a0e54 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:15:12.658685 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f8400de7-18f6-43f9-a899-33b7c51a0e54 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:12.659155 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f8400de7-18f6-43f9-a899-33b7c51a0e54 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:12.659898 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f8400de7-18f6-43f9-a899-33b7c51a0e54 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:12.660322 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f8400de7-18f6-43f9-a899-33b7c51a0e54 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:12.788335 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-f8400de7-18f6-43f9-a899-33b7c51a0e54 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:15:12.796472 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-f8400de7-18f6-43f9-a899-33b7c51a0e54 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1677 microversion: 2.1 time: 0.148681 Aug 03 13:15:12.797027 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 609/1214] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:15:12 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:15:13.817534 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-2b131fc8-313f-4524-ac99-51763f0ae014 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:15:13.818071 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-2b131fc8-313f-4524-ac99-51763f0ae014 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:15:13.825068 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2b131fc8-313f-4524-ac99-51763f0ae014 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:13.825520 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2b131fc8-313f-4524-ac99-51763f0ae014 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:13.826273 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2b131fc8-313f-4524-ac99-51763f0ae014 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:13.826704 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2b131fc8-313f-4524-ac99-51763f0ae014 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:13.957876 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-2b131fc8-313f-4524-ac99-51763f0ae014 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:15:13.965894 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-2b131fc8-313f-4524-ac99-51763f0ae014 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1677 microversion: 2.1 time: 0.152262 Aug 03 13:15:13.966454 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 606/1215] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:15:13 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:15:14.987109 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ddbe6700-a307-4d79-8109-b61a26dcb0f0 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:15:14.987721 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-ddbe6700-a307-4d79-8109-b61a26dcb0f0 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:15:14.994329 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ddbe6700-a307-4d79-8109-b61a26dcb0f0 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:14.994872 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ddbe6700-a307-4d79-8109-b61a26dcb0f0 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:14.995644 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ddbe6700-a307-4d79-8109-b61a26dcb0f0 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:14.996081 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ddbe6700-a307-4d79-8109-b61a26dcb0f0 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:15.123302 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ddbe6700-a307-4d79-8109-b61a26dcb0f0 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:15:15.133540 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-ddbe6700-a307-4d79-8109-b61a26dcb0f0 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1677 microversion: 2.1 time: 0.149960 Aug 03 13:15:15.134566 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 610/1216] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:15:14 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:15:16.155507 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-75d4f146-d103-4980-be95-e4109f5834eb tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:15:16.156044 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-75d4f146-d103-4980-be95-e4109f5834eb tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:15:16.162756 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-75d4f146-d103-4980-be95-e4109f5834eb tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:16.163214 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-75d4f146-d103-4980-be95-e4109f5834eb tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:16.163977 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-75d4f146-d103-4980-be95-e4109f5834eb tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:16.164417 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-75d4f146-d103-4980-be95-e4109f5834eb tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:16.293637 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-75d4f146-d103-4980-be95-e4109f5834eb tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:15:16.301064 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-75d4f146-d103-4980-be95-e4109f5834eb tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1677 microversion: 2.1 time: 0.149590 Aug 03 13:15:16.301628 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 607/1217] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:15:16 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:15:17.322853 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-84c5e1ab-0b62-40b6-b3d8-19d833dbcce3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:15:17.323480 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-84c5e1ab-0b62-40b6-b3d8-19d833dbcce3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:15:17.330645 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-84c5e1ab-0b62-40b6-b3d8-19d833dbcce3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:17.331072 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-84c5e1ab-0b62-40b6-b3d8-19d833dbcce3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:17.331833 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-84c5e1ab-0b62-40b6-b3d8-19d833dbcce3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:17.332269 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-84c5e1ab-0b62-40b6-b3d8-19d833dbcce3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:17.462574 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-84c5e1ab-0b62-40b6-b3d8-19d833dbcce3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:15:17.470111 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-84c5e1ab-0b62-40b6-b3d8-19d833dbcce3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1677 microversion: 2.1 time: 0.151196 Aug 03 13:15:17.470705 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 611/1218] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:15:17 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:15:18.492313 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-30c9b8ea-10ad-4757-b69c-f8dcb5d9c287 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:15:18.492931 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-30c9b8ea-10ad-4757-b69c-f8dcb5d9c287 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:15:18.499438 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-30c9b8ea-10ad-4757-b69c-f8dcb5d9c287 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:18.499894 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-30c9b8ea-10ad-4757-b69c-f8dcb5d9c287 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:18.500656 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-30c9b8ea-10ad-4757-b69c-f8dcb5d9c287 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:18.501095 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-30c9b8ea-10ad-4757-b69c-f8dcb5d9c287 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:18.626847 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-30c9b8ea-10ad-4757-b69c-f8dcb5d9c287 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:15:18.647234 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-30c9b8ea-10ad-4757-b69c-f8dcb5d9c287 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1677 microversion: 2.1 time: 0.146412 Aug 03 13:15:18.647234 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 608/1219] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:15:18 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:15:19.657023 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-6506e074-c5b4-4668-aa96-63538adf990d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:15:19.657638 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-6506e074-c5b4-4668-aa96-63538adf990d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:15:19.664242 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6506e074-c5b4-4668-aa96-63538adf990d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:19.664691 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6506e074-c5b4-4668-aa96-63538adf990d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:19.665454 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6506e074-c5b4-4668-aa96-63538adf990d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:19.665889 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6506e074-c5b4-4668-aa96-63538adf990d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:19.794909 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-6506e074-c5b4-4668-aa96-63538adf990d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:15:19.802264 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-6506e074-c5b4-4668-aa96-63538adf990d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1677 microversion: 2.1 time: 0.149693 Aug 03 13:15:19.802851 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 612/1220] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:15:19 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:15:20.823139 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-2962e357-ac40-43c6-a863-aa9cf4aac4a4 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:15:20.823747 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-2962e357-ac40-43c6-a863-aa9cf4aac4a4 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:15:20.830292 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2962e357-ac40-43c6-a863-aa9cf4aac4a4 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:20.830750 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2962e357-ac40-43c6-a863-aa9cf4aac4a4 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:20.831510 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2962e357-ac40-43c6-a863-aa9cf4aac4a4 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:20.833692 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2962e357-ac40-43c6-a863-aa9cf4aac4a4 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:20.960740 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-2962e357-ac40-43c6-a863-aa9cf4aac4a4 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:15:20.968862 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-2962e357-ac40-43c6-a863-aa9cf4aac4a4 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1677 microversion: 2.1 time: 0.149486 Aug 03 13:15:20.969645 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 609/1221] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:15:20 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:15:21.992326 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-fa874ce1-d924-473c-8937-d1d5990acfa8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:15:21.992937 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-fa874ce1-d924-473c-8937-d1d5990acfa8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:15:22.000545 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fa874ce1-d924-473c-8937-d1d5990acfa8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:22.000999 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fa874ce1-d924-473c-8937-d1d5990acfa8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:22.001758 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fa874ce1-d924-473c-8937-d1d5990acfa8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:22.002212 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fa874ce1-d924-473c-8937-d1d5990acfa8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:22.131836 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-fa874ce1-d924-473c-8937-d1d5990acfa8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:15:22.139256 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-fa874ce1-d924-473c-8937-d1d5990acfa8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1654 microversion: 2.1 time: 0.150835 Aug 03 13:15:22.139821 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 613/1222] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:15:21 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1654 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:15:22.159475 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-3abf4ab8-9d32-46b7-9e00-78f4b68e9559 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:15:22.166184 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3abf4ab8-9d32-46b7-9e00-78f4b68e9559 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:22.166672 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3abf4ab8-9d32-46b7-9e00-78f4b68e9559 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:22.188922 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-3abf4ab8-9d32-46b7-9e00-78f4b68e9559 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Going to try to start instance {{(pid=119410) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 03 13:15:22.355405 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-3abf4ab8-9d32-46b7-9e00-78f4b68e9559 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "POST /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25/action" status: 202 len: 0 microversion: 2.1 time: 0.199533 Aug 03 13:15:22.355930 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 610/1223] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Aug 3 13:15:22 2022] POST /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 13:15:22.365096 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ea4f6e48-186b-4622-ad6e-3a9e3ab9fc07 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:15:22.365703 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-ea4f6e48-186b-4622-ad6e-3a9e3ab9fc07 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:15:22.371592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ea4f6e48-186b-4622-ad6e-3a9e3ab9fc07 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:22.372089 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ea4f6e48-186b-4622-ad6e-3a9e3ab9fc07 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:22.372879 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ea4f6e48-186b-4622-ad6e-3a9e3ab9fc07 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:22.373309 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ea4f6e48-186b-4622-ad6e-3a9e3ab9fc07 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:22.502865 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ea4f6e48-186b-4622-ad6e-3a9e3ab9fc07 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:15:22.510938 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-ea4f6e48-186b-4622-ad6e-3a9e3ab9fc07 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1663 microversion: 2.1 time: 0.149687 Aug 03 13:15:22.511501 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 614/1224] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:15:22 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1663 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:15:23.534103 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1d0c0fe1-970e-4a1d-8cd9-4da3b2efc341 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:15:23.534824 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-1d0c0fe1-970e-4a1d-8cd9-4da3b2efc341 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:15:23.541193 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1d0c0fe1-970e-4a1d-8cd9-4da3b2efc341 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:23.541636 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1d0c0fe1-970e-4a1d-8cd9-4da3b2efc341 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:23.542380 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1d0c0fe1-970e-4a1d-8cd9-4da3b2efc341 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:23.542835 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1d0c0fe1-970e-4a1d-8cd9-4da3b2efc341 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:23.667959 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-1d0c0fe1-970e-4a1d-8cd9-4da3b2efc341 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:15:23.675446 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-1d0c0fe1-970e-4a1d-8cd9-4da3b2efc341 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1663 microversion: 2.1 time: 0.146684 Aug 03 13:15:23.676019 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 611/1225] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:15:23 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1663 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:15:24.696764 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-c281fa06-b9a9-4d97-883a-67110b6ec9b3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:15:24.697407 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-c281fa06-b9a9-4d97-883a-67110b6ec9b3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:15:24.704581 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c281fa06-b9a9-4d97-883a-67110b6ec9b3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:24.705010 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c281fa06-b9a9-4d97-883a-67110b6ec9b3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:24.705773 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c281fa06-b9a9-4d97-883a-67110b6ec9b3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:15:24.706210 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-c281fa06-b9a9-4d97-883a-67110b6ec9b3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:15:24.833648 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-c281fa06-b9a9-4d97-883a-67110b6ec9b3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:15:24.841123 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-c281fa06-b9a9-4d97-883a-67110b6ec9b3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1667 microversion: 2.1 time: 0.148210 Aug 03 13:15:24.841689 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 615/1226] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:15:24 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1667 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:16:19.843132 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-9f09d52d-7e6a-47bb-8411-491727822f1e tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:16:19.845258 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-9f09d52d-7e6a-47bb-8411-491727822f1e tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:16:19.847677 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=16 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:19.848482 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:19.853193 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9f09d52d-7e6a-47bb-8411-491727822f1e tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:19.853645 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9f09d52d-7e6a-47bb-8411-491727822f1e tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:19.854400 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9f09d52d-7e6a-47bb-8411-491727822f1e tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:19.854879 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9f09d52d-7e6a-47bb-8411-491727822f1e tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:19.882298 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-9f09d52d-7e6a-47bb-8411-491727822f1e tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043623 Aug 03 13:16:19.882947 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 612/1227] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 3 13:16:19 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 13:16:19.943656 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-8e6e4d6a-a56d-4028-abfe-cf2bccbc90b8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:16:19.944166 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-8e6e4d6a-a56d-4028-abfe-cf2bccbc90b8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:16:19.946440 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=18 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:19.947110 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=1 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:19.952341 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8e6e4d6a-a56d-4028-abfe-cf2bccbc90b8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:19.960763 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8e6e4d6a-a56d-4028-abfe-cf2bccbc90b8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:19.960763 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8e6e4d6a-a56d-4028-abfe-cf2bccbc90b8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:19.960763 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-8e6e4d6a-a56d-4028-abfe-cf2bccbc90b8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:19.979873 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-8e6e4d6a-a56d-4028-abfe-cf2bccbc90b8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Going to try to terminate instance {{(pid=119409) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 13:16:20.288014 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-8e6e4d6a-a56d-4028-abfe-cf2bccbc90b8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "DELETE /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 204 len: 0 microversion: 2.1 time: 0.347855 Aug 03 13:16:20.288597 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 616/1228] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 3 13:16:19 2022] DELETE /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 13:16:20.298204 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-ff0dfde7-6361-4acd-86f4-1e8f22cce1d6 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:16:20.299002 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-ff0dfde7-6361-4acd-86f4-1e8f22cce1d6 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:16:20.306354 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ff0dfde7-6361-4acd-86f4-1e8f22cce1d6 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:20.306832 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ff0dfde7-6361-4acd-86f4-1e8f22cce1d6 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:20.307632 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ff0dfde7-6361-4acd-86f4-1e8f22cce1d6 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:20.308068 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ff0dfde7-6361-4acd-86f4-1e8f22cce1d6 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:20.442135 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ff0dfde7-6361-4acd-86f4-1e8f22cce1d6 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:16:20.449536 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-ff0dfde7-6361-4acd-86f4-1e8f22cce1d6 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1673 microversion: 2.1 time: 0.156736 Aug 03 13:16:20.450101 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 613/1229] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:16:20 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:16:20.461344 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 13:16:20.461507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Wed Aug 3 13:16:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 13:16:21.472416 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-a3932039-6e1c-45f7-ab8f-feaa4fd1d908 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:16:21.473114 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-a3932039-6e1c-45f7-ab8f-feaa4fd1d908 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:16:21.480771 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a3932039-6e1c-45f7-ab8f-feaa4fd1d908 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:21.481212 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a3932039-6e1c-45f7-ab8f-feaa4fd1d908 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:21.481971 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a3932039-6e1c-45f7-ab8f-feaa4fd1d908 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:21.482403 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a3932039-6e1c-45f7-ab8f-feaa4fd1d908 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:21.612722 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-a3932039-6e1c-45f7-ab8f-feaa4fd1d908 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:16:21.620383 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-a3932039-6e1c-45f7-ab8f-feaa4fd1d908 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1673 microversion: 2.1 time: 0.152262 Aug 03 13:16:21.620940 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 617/1230] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:16:21 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:16:22.641581 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e956b199-3d2d-4df5-bec7-10499b673408 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:16:22.642198 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-e956b199-3d2d-4df5-bec7-10499b673408 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:16:22.649083 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e956b199-3d2d-4df5-bec7-10499b673408 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:22.649534 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e956b199-3d2d-4df5-bec7-10499b673408 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:22.650300 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e956b199-3d2d-4df5-bec7-10499b673408 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:22.650757 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e956b199-3d2d-4df5-bec7-10499b673408 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:22.779338 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-e956b199-3d2d-4df5-bec7-10499b673408 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:16:22.787180 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-e956b199-3d2d-4df5-bec7-10499b673408 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1673 microversion: 2.1 time: 0.149611 Aug 03 13:16:22.787752 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 614/1231] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:16:22 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:16:23.571689 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-e02ca88f-41f5-4354-97f3-526a446f0b74 req-57989f70-5335-4cda-9e88-d51f6f50a134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "327747f6-507a-42b7-a7bc-56b2947b0d25", "name": "network-vif-deleted", "tag": "3d2c161e-d182-46f5-86bd-f86a50b004bd"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:16:23.585070 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-e02ca88f-41f5-4354-97f3-526a446f0b74 req-57989f70-5335-4cda-9e88-d51f6f50a134 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:23.585070 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-e02ca88f-41f5-4354-97f3-526a446f0b74 req-57989f70-5335-4cda-9e88-d51f6f50a134 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:23.596017 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-e02ca88f-41f5-4354-97f3-526a446f0b74 req-57989f70-5335-4cda-9e88-d51f6f50a134 service nova] Creating event network-vif-deleted:3d2c161e-d182-46f5-86bd-f86a50b004bd for instance 327747f6-507a-42b7-a7bc-56b2947b0d25 on hv-cinder-85083 Aug 03 13:16:23.602379 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-e02ca88f-41f5-4354-97f3-526a446f0b74 req-57989f70-5335-4cda-9e88-d51f6f50a134 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162399 Aug 03 13:16:23.603297 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 618/1232] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:16:23.813260 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d69d9083-f4dc-4cf0-ac0d-04bedee3ebd2 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:16:23.813987 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d69d9083-f4dc-4cf0-ac0d-04bedee3ebd2 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:16:23.821835 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d69d9083-f4dc-4cf0-ac0d-04bedee3ebd2 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:23.822385 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d69d9083-f4dc-4cf0-ac0d-04bedee3ebd2 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:23.823282 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d69d9083-f4dc-4cf0-ac0d-04bedee3ebd2 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:23.823782 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d69d9083-f4dc-4cf0-ac0d-04bedee3ebd2 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:23.857307 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d69d9083-f4dc-4cf0-ac0d-04bedee3ebd2 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:23.857751 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d69d9083-f4dc-4cf0-ac0d-04bedee3ebd2 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:23.858455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-d69d9083-f4dc-4cf0-ac0d-04bedee3ebd2 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lazy-loading 'fault' on Instance uuid 327747f6-507a-42b7-a7bc-56b2947b0d25 {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:16:23.899078 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d69d9083-f4dc-4cf0-ac0d-04bedee3ebd2 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:16:23.906844 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d69d9083-f4dc-4cf0-ac0d-04bedee3ebd2 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 200 len: 1327 microversion: 2.1 time: 0.097934 Aug 03 13:16:23.907426 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 615/1233] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:16:23 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 1327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:16:24.929054 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-0d5ce806-3d2f-43b0-a503-9ab05fd212ff tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:16:24.929742 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-0d5ce806-3d2f-43b0-a503-9ab05fd212ff tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:16:24.936408 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0d5ce806-3d2f-43b0-a503-9ab05fd212ff tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:24.936876 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0d5ce806-3d2f-43b0-a503-9ab05fd212ff tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:24.937622 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0d5ce806-3d2f-43b0-a503-9ab05fd212ff tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:24.938048 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-0d5ce806-3d2f-43b0-a503-9ab05fd212ff tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:24.950897 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-0d5ce806-3d2f-43b0-a503-9ab05fd212ff tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] HTTP exception thrown: Instance 327747f6-507a-42b7-a7bc-56b2947b0d25 could not be found. Aug 03 13:16:24.953051 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-0d5ce806-3d2f-43b0-a503-9ab05fd212ff tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Request method failure captured: Aug 03 13:16:24.953051 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 HTTP/1.1 Aug 03 13:16:24.953051 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 13:16:24.953051 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 13:16:24.953051 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 13:16:24.953051 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 0 Aug 03 13:16:24.953051 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 13:16:24.953051 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 13:16:24.953051 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 13:16:24.953051 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 13:16:24.953051 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nQHZGJ5uDuXP1tWz-tHGbmAQk2UsQ7n-jqFev-gLzu9A9iFbbGEDXzK1sa40OnntU82Hi4myrQ7yJ5KWMHj2qMG0ZJOpqstT4meiCUKrBmnmB3YHFxGhI3oNUqTkqviPM5768fPkKxnVrC6w3tZLuCzcxWg8RNVn0WJi8ikdBM_QFE Aug 03 13:16:24.953051 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 13:16:24.953051 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 13:16:24.953051 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 13:16:24.953051 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 13:16:24.953051 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 13:16:24.953051 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 13:16:24.953051 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: 965502bfffde4ee19c6bd7ea81f08672 Aug 03 13:16:24.953051 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-AttachVolumeTestJSON-1928055744 Aug 03 13:16:24.953051 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 13:16:24.953051 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 13:16:24.954784 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/965502bfffde4ee19c6bd7ea81f08672"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/965502bfffde4ee19c6bd7ea81f08672"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/965502bfffde4ee19c6bd7ea81f08672"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_965502bfffde4ee19c6bd7ea81f08672", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:16:24.954784 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-AttachVolumeTestJSON-1928055744 Aug 03 13:16:24.954784 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: 965502bfffde4ee19c6bd7ea81f08672 Aug 03 13:16:24.954784 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1928055744 Aug 03 13:16:24.954784 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-AttachVolumeTestJSON-1928055744-project Aug 03 13:16:24.954784 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 13:16:24.954784 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 13:16:24.954784 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: 90109591e9cd43b9aab0fe5b1593e9dd Aug 03 13:16:24.954784 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-AttachVolumeTestJSON-1928055744-project Aug 03 13:16:24.954784 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: > Aug 03 13:16:24.954784 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Instance 327747f6-507a-42b7-a7bc-56b2947b0d25 could not be found. Aug 03 13:16:24.954784 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'id': '327747f6-507a-42b7-a7bc-56b2947b0d25'} Aug 03 13:16:24.955818 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:16:24.955818 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:16:24.955818 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:16:24.955818 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:16:24.955818 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:16:24.955818 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:16:24.955818 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:16:24.955818 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:16:24.955818 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:16:24.955818 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:16:24.955818 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 327747f6-507a-42b7-a7bc-56b2947b0d25 could not be found. Aug 03 13:16:24.955818 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:16:24.955818 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:16:24.955818 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:16:24.955818 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:16:24.955818 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:16:24.955818 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:16:24.955818 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:16:24.955818 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:16:24.955818 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:16:24.957406 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:16:24.957406 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:16:24.957406 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:16:24.957406 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:16:24.957406 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:16:24.957406 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:16:24.957406 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:16:24.957406 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 327747f6-507a-42b7-a7bc-56b2947b0d25 could not be found. Aug 03 13:16:24.957406 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:16:24.957406 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:16:24.957406 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:16:24.957406 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:16:24.957406 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:16:24.957406 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:16:24.957406 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:16:24.957406 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:16:24.957406 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 327747f6-507a-42b7-a7bc-56b2947b0d25 could not be found. Aug 03 13:16:24.957406 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:16:24.958827 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-0d5ce806-3d2f-43b0-a503-9ab05fd212ff tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Returning 404 to user: Instance 327747f6-507a-42b7-a7bc-56b2947b0d25 could not be found. {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:16:24.958827 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-0d5ce806-3d2f-43b0-a503-9ab05fd212ff tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 404 len: 111 microversion: 2.1 time: 0.029532 Aug 03 13:16:24.958827 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 619/1234] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:16:24 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:16:24.963197 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-58fd8093-cbaa-4166-bfd0-31213cc1b411 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '.version_select at 0x7fe6cbe8a8b0>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:16:25.032355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-58fd8093-cbaa-4166-bfd0-31213cc1b411 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2143444063" status: 202 len: 0 microversion: 2.1 time: 0.072794 Aug 03 13:16:25.032917 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 616/1235] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Aug 3 13:16:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2143444063 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 13:16:25.779722 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-470abd58-988b-4193-a57e-21775198dcd0 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Action: 'create', calling method: .version_select at 0x7fe6d82ffa60>, body: {"keypair": {"name": "tempest-keypair-1035187641", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVUO+VtKyHpdpZdKH4znlA94Az1GC0uetFAQce5FKbL4n/TwmDsUmcnEf+52WiFglIzYzXl5wZOH/Pgl8XJSrCRVEFXMs1t8rii99SLan6Y4qkGH9tSkXWWoCsqg5k31Q=="}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:16:25.795222 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-470abd58-988b-4193-a57e-21775198dcd0 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Getting quotas for project 965502bfffde4ee19c6bd7ea81f08672. Resources: {'key_pairs'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 13:16:25.799586 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-470abd58-988b-4193-a57e-21775198dcd0 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Getting quotas for user 90109591e9cd43b9aab0fe5b1593e9dd and project 965502bfffde4ee19c6bd7ea81f08672. Resources: {'key_pairs'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 13:16:25.871467 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-470abd58-988b-4193-a57e-21775198dcd0 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.095608 Aug 03 13:16:25.872087 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 620/1236] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Aug 3 13:16:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:16:27.940918 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-247e01f6-9596-4132-9059-3a2dcd383619 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-76308980", "imageRef": "c0aabcc0-d4af-4f0e-b8a5-d140344fce1f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "61fecd84-12d8-4d6c-a6e7-c642370f59bf"}], "security_groups": [{"name": "tempest-securitygroup--1405948932"}], "key_name": "tempest-keypair-1035187641", "user_data": "}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:16:28.042306 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.network.neutron [None req-247e01f6-9596-4132-9059-3a2dcd383619 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] validate_networks() for [('61fecd84-12d8-4d6c-a6e7-c642370f59bf', None, None, None, None, None)] {{(pid=119410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 13:16:28.447317 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-247e01f6-9596-4132-9059-3a2dcd383619 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Flavor limits 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 13:16:28.447737 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-247e01f6-9596-4132-9059-3a2dcd383619 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Image limits 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 13:16:28.448210 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-247e01f6-9596-4132-9059-3a2dcd383619 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Flavor pref 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 13:16:28.448619 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-247e01f6-9596-4132-9059-3a2dcd383619 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Image pref 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 13:16:28.449025 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-247e01f6-9596-4132-9059-3a2dcd383619 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 13:16:28.458403 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-247e01f6-9596-4132-9059-3a2dcd383619 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:28.458891 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-247e01f6-9596-4132-9059-3a2dcd383619 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:28.459688 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-247e01f6-9596-4132-9059-3a2dcd383619 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:28.460121 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-247e01f6-9596-4132-9059-3a2dcd383619 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:28.480030 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.quota [None req-247e01f6-9596-4132-9059-3a2dcd383619 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Getting quotas for project 965502bfffde4ee19c6bd7ea81f08672. Resources: {'instances', 'ram', 'cores'} {{(pid=119410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 13:16:28.483967 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.quota [None req-247e01f6-9596-4132-9059-3a2dcd383619 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Getting quotas for user 90109591e9cd43b9aab0fe5b1593e9dd and project 965502bfffde4ee19c6bd7ea81f08672. Resources: {'instances', 'ram', 'cores'} {{(pid=119410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 13:16:28.495131 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-247e01f6-9596-4132-9059-3a2dcd383619 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Going to run 1 instances... {{(pid=119410) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 13:16:28.497379 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-247e01f6-9596-4132-9059-3a2dcd383619 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0aabcc0-d4af-4f0e-b8a5-d140344fce1f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 13:16:28.622107 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-247e01f6-9596-4132-9059-3a2dcd383619 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.685977 Aug 03 13:16:28.622686 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 617/1237] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 3 13:16:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 13:16:28.634412 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d068cbe1-e697-4d81-b455-d82126f7bddc tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:16:28.635063 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-d068cbe1-e697-4d81-b455-d82126f7bddc tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:16:28.689059 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-d068cbe1-e697-4d81-b455-d82126f7bddc tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:16:28.695667 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-d068cbe1-e697-4d81-b455-d82126f7bddc tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b" status: 200 len: 1236 microversion: 2.1 time: 0.065522 Aug 03 13:16:28.696265 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 621/1238] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:16:28 2022] GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b => generated 1236 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:16:29.716756 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-9df6c950-1a7e-43ee-96fb-c0cd12c7fdbe tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:16:29.717950 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-9df6c950-1a7e-43ee-96fb-c0cd12c7fdbe tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:16:29.724094 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9df6c950-1a7e-43ee-96fb-c0cd12c7fdbe tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:29.724567 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9df6c950-1a7e-43ee-96fb-c0cd12c7fdbe tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:29.725304 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9df6c950-1a7e-43ee-96fb-c0cd12c7fdbe tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:29.725740 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-9df6c950-1a7e-43ee-96fb-c0cd12c7fdbe tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:29.792867 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-9df6c950-1a7e-43ee-96fb-c0cd12c7fdbe tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:16:29.800306 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-9df6c950-1a7e-43ee-96fb-c0cd12c7fdbe tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b" status: 200 len: 1232 microversion: 2.1 time: 0.087923 Aug 03 13:16:29.800883 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 618/1239] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:16:29 2022] GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b => generated 1232 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:16:30.821559 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-f6370216-9adf-4a64-9313-917a99f4a64a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:16:30.822109 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-f6370216-9adf-4a64-9313-917a99f4a64a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:16:30.829335 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f6370216-9adf-4a64-9313-917a99f4a64a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:30.829788 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f6370216-9adf-4a64-9313-917a99f4a64a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:30.830556 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f6370216-9adf-4a64-9313-917a99f4a64a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:30.831043 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-f6370216-9adf-4a64-9313-917a99f4a64a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:30.894099 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-f6370216-9adf-4a64-9313-917a99f4a64a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:16:30.901839 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-f6370216-9adf-4a64-9313-917a99f4a64a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b" status: 200 len: 1306 microversion: 2.1 time: 0.084283 Aug 03 13:16:30.907059 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 622/1240] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:16:30 2022] GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b => generated 1306 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:16:31.923725 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-18f491ec-290d-475c-8cca-571c1fd1ba4f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:16:31.924376 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-18f491ec-290d-475c-8cca-571c1fd1ba4f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:16:31.931098 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-18f491ec-290d-475c-8cca-571c1fd1ba4f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:31.931539 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-18f491ec-290d-475c-8cca-571c1fd1ba4f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:31.932299 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-18f491ec-290d-475c-8cca-571c1fd1ba4f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:31.932728 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-18f491ec-290d-475c-8cca-571c1fd1ba4f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:32.069504 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-18f491ec-290d-475c-8cca-571c1fd1ba4f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:16:32.077863 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-18f491ec-290d-475c-8cca-571c1fd1ba4f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b" status: 200 len: 1362 microversion: 2.1 time: 0.158274 Aug 03 13:16:32.078655 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 619/1241] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:16:31 2022] GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:16:32.442567 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-714bf45c-cc4b-4be3-9cdb-0489ac0a05e8 req-f1ce2b93-1647-4488-bdfb-d09a630553e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cc55200-5481-4c78-9969-164d7a36be0b", "tag": "86a30b5b-5124-4720-86c9-56d135755579"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:16:32.453602 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-714bf45c-cc4b-4be3-9cdb-0489ac0a05e8 req-f1ce2b93-1647-4488-bdfb-d09a630553e0 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:32.454039 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-714bf45c-cc4b-4be3-9cdb-0489ac0a05e8 req-f1ce2b93-1647-4488-bdfb-d09a630553e0 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:32.464758 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-714bf45c-cc4b-4be3-9cdb-0489ac0a05e8 req-f1ce2b93-1647-4488-bdfb-d09a630553e0 service nova] Creating event network-changed:86a30b5b-5124-4720-86c9-56d135755579 for instance 1cc55200-5481-4c78-9969-164d7a36be0b on hv-cinder-85083 Aug 03 13:16:32.470768 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-714bf45c-cc4b-4be3-9cdb-0489ac0a05e8 req-f1ce2b93-1647-4488-bdfb-d09a630553e0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033252 Aug 03 13:16:32.471364 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 623/1242] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:16:33.099695 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-4ff6161a-6f94-42a2-abc1-9c0402f8c330 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:16:33.100861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-4ff6161a-6f94-42a2-abc1-9c0402f8c330 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:16:33.107458 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4ff6161a-6f94-42a2-abc1-9c0402f8c330 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:33.107907 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4ff6161a-6f94-42a2-abc1-9c0402f8c330 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:33.109237 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4ff6161a-6f94-42a2-abc1-9c0402f8c330 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:33.109669 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-4ff6161a-6f94-42a2-abc1-9c0402f8c330 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:33.240706 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-4ff6161a-6f94-42a2-abc1-9c0402f8c330 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:16:33.248224 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-4ff6161a-6f94-42a2-abc1-9c0402f8c330 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b" status: 200 len: 1362 microversion: 2.1 time: 0.152349 Aug 03 13:16:33.248793 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 620/1243] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:16:33 2022] GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:16:34.270453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-74a17571-9cc7-491b-b900-91adc0aa91c7 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:16:34.271178 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-74a17571-9cc7-491b-b900-91adc0aa91c7 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:16:34.277786 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-74a17571-9cc7-491b-b900-91adc0aa91c7 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:34.278233 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-74a17571-9cc7-491b-b900-91adc0aa91c7 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:34.279021 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-74a17571-9cc7-491b-b900-91adc0aa91c7 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:34.279457 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-74a17571-9cc7-491b-b900-91adc0aa91c7 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:34.406981 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-74a17571-9cc7-491b-b900-91adc0aa91c7 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:16:34.414574 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-74a17571-9cc7-491b-b900-91adc0aa91c7 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b" status: 200 len: 1362 microversion: 2.1 time: 0.148273 Aug 03 13:16:34.415161 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 624/1244] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:16:34 2022] GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:16:35.490460 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-8f4336c1-5ee1-4f99-b4a2-27b9a71eb1e6 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:16:35.491092 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-8f4336c1-5ee1-4f99-b4a2-27b9a71eb1e6 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:16:35.497011 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8f4336c1-5ee1-4f99-b4a2-27b9a71eb1e6 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:35.497452 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8f4336c1-5ee1-4f99-b4a2-27b9a71eb1e6 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:35.498194 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8f4336c1-5ee1-4f99-b4a2-27b9a71eb1e6 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:35.498618 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-8f4336c1-5ee1-4f99-b4a2-27b9a71eb1e6 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:35.623528 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-8f4336c1-5ee1-4f99-b4a2-27b9a71eb1e6 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:16:35.631423 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-8f4336c1-5ee1-4f99-b4a2-27b9a71eb1e6 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b" status: 200 len: 1362 microversion: 2.1 time: 0.199962 Aug 03 13:16:35.631988 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 621/1245] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:16:35 2022] GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:16:36.652079 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-6f36fc7c-9569-4fc2-b379-91678f1680c2 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:16:36.652692 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-6f36fc7c-9569-4fc2-b379-91678f1680c2 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:16:36.659821 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6f36fc7c-9569-4fc2-b379-91678f1680c2 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:36.660274 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6f36fc7c-9569-4fc2-b379-91678f1680c2 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:36.661304 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6f36fc7c-9569-4fc2-b379-91678f1680c2 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:36.661739 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-6f36fc7c-9569-4fc2-b379-91678f1680c2 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:36.803866 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-6f36fc7c-9569-4fc2-b379-91678f1680c2 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:16:36.811333 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-6f36fc7c-9569-4fc2-b379-91678f1680c2 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b" status: 200 len: 1362 microversion: 2.1 time: 0.163195 Aug 03 13:16:36.811887 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 625/1246] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:16:36 2022] GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:16:37.832220 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-5f09b525-3c67-4198-ac80-cae061348823 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:16:37.832865 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-5f09b525-3c67-4198-ac80-cae061348823 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:16:37.839655 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5f09b525-3c67-4198-ac80-cae061348823 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:37.840108 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5f09b525-3c67-4198-ac80-cae061348823 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:37.840891 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5f09b525-3c67-4198-ac80-cae061348823 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:37.841326 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5f09b525-3c67-4198-ac80-cae061348823 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:37.976095 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-5f09b525-3c67-4198-ac80-cae061348823 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:16:37.982073 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-5f09b525-3c67-4198-ac80-cae061348823 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b" status: 200 len: 1362 microversion: 2.1 time: 0.153766 Aug 03 13:16:37.982646 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 622/1247] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:16:37 2022] GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:16:39.003483 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-2ce9347c-3615-4de6-a6e8-b73fed4881a9 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:16:39.008436 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-2ce9347c-3615-4de6-a6e8-b73fed4881a9 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:16:39.008436 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell0:SELECT=6 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:39.011597 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2ce9347c-3615-4de6-a6e8-b73fed4881a9 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:39.012045 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2ce9347c-3615-4de6-a6e8-b73fed4881a9 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:39.012804 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2ce9347c-3615-4de6-a6e8-b73fed4881a9 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:39.013241 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2ce9347c-3615-4de6-a6e8-b73fed4881a9 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:39.148028 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-2ce9347c-3615-4de6-a6e8-b73fed4881a9 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:16:39.155700 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-2ce9347c-3615-4de6-a6e8-b73fed4881a9 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b" status: 200 len: 1362 microversion: 2.1 time: 0.155978 Aug 03 13:16:39.156266 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 626/1248] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:16:38 2022] GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:16:39.306580 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=2 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:39.307879 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=6 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:39.361461 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-170c6a31-54f1-46a2-a84a-6aa200e937b3 req-57611638-6f6f-4018-96f7-91ffcc252efe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cc55200-5481-4c78-9969-164d7a36be0b", "name": "network-vif-plugged", "status": "completed", "tag": "86a30b5b-5124-4720-86c9-56d135755579"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:16:39.370985 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-170c6a31-54f1-46a2-a84a-6aa200e937b3 req-57611638-6f6f-4018-96f7-91ffcc252efe service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:39.371419 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-170c6a31-54f1-46a2-a84a-6aa200e937b3 req-57611638-6f6f-4018-96f7-91ffcc252efe service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:39.382753 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-170c6a31-54f1-46a2-a84a-6aa200e937b3 req-57611638-6f6f-4018-96f7-91ffcc252efe service nova] Creating event network-vif-plugged:86a30b5b-5124-4720-86c9-56d135755579 for instance 1cc55200-5481-4c78-9969-164d7a36be0b on hv-cinder-85083 Aug 03 13:16:39.387813 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-170c6a31-54f1-46a2-a84a-6aa200e937b3 req-57611638-6f6f-4018-96f7-91ffcc252efe service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085459 Aug 03 13:16:39.388445 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 623/1249] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:16:40.177177 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-50ec7df3-58eb-4553-b6c7-a7b515c9e376 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:16:40.177787 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-50ec7df3-58eb-4553-b6c7-a7b515c9e376 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:16:40.184219 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-50ec7df3-58eb-4553-b6c7-a7b515c9e376 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:40.184664 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-50ec7df3-58eb-4553-b6c7-a7b515c9e376 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:40.185418 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-50ec7df3-58eb-4553-b6c7-a7b515c9e376 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:40.185843 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-50ec7df3-58eb-4553-b6c7-a7b515c9e376 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:40.311836 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-50ec7df3-58eb-4553-b6c7-a7b515c9e376 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:16:40.319217 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-50ec7df3-58eb-4553-b6c7-a7b515c9e376 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b" status: 200 len: 1362 microversion: 2.1 time: 0.145886 Aug 03 13:16:40.319782 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 627/1250] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:16:40 2022] GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:16:41.340661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-5447498c-84ce-4451-b16e-60be9b252de7 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:16:41.341292 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-5447498c-84ce-4451-b16e-60be9b252de7 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:16:41.349079 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5447498c-84ce-4451-b16e-60be9b252de7 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:41.353492 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5447498c-84ce-4451-b16e-60be9b252de7 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:41.353492 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5447498c-84ce-4451-b16e-60be9b252de7 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:41.353492 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-5447498c-84ce-4451-b16e-60be9b252de7 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:41.493662 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-5447498c-84ce-4451-b16e-60be9b252de7 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:16:41.501841 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-5447498c-84ce-4451-b16e-60be9b252de7 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b" status: 200 len: 1547 microversion: 2.1 time: 0.166163 Aug 03 13:16:41.502513 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 624/1251] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:16:41 2022] GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b => generated 1547 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:16:41.521775 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-7902956c-c769-4187-bd77-5322b22e3cfd tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:16:41.522303 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-7902956c-c769-4187-bd77-5322b22e3cfd tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:16:41.528792 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7902956c-c769-4187-bd77-5322b22e3cfd tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:41.529230 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7902956c-c769-4187-bd77-5322b22e3cfd tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:41.530050 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7902956c-c769-4187-bd77-5322b22e3cfd tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:41.530504 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7902956c-c769-4187-bd77-5322b22e3cfd tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:41.837759 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-7902956c-c769-4187-bd77-5322b22e3cfd tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.319780 Aug 03 13:16:41.838358 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 628/1252] 10.222.0.64 () {58 vars in 1275 bytes} [Wed Aug 3 13:16:41 2022] GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b/os-interface => generated 284 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:16:42.839146 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-1331cddc-9064-4f1a-abe8-250f2a131bab req-85e456e1-d040-4345-a43f-734146dc7e67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cc55200-5481-4c78-9969-164d7a36be0b", "tag": "86a30b5b-5124-4720-86c9-56d135755579"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:16:42.849317 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-1331cddc-9064-4f1a-abe8-250f2a131bab req-85e456e1-d040-4345-a43f-734146dc7e67 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:16:42.849828 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-1331cddc-9064-4f1a-abe8-250f2a131bab req-85e456e1-d040-4345-a43f-734146dc7e67 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:16:42.863471 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-1331cddc-9064-4f1a-abe8-250f2a131bab req-85e456e1-d040-4345-a43f-734146dc7e67 service nova] Creating event network-changed:86a30b5b-5124-4720-86c9-56d135755579 for instance 1cc55200-5481-4c78-9969-164d7a36be0b on hv-cinder-85083 Aug 03 13:16:42.868546 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-1331cddc-9064-4f1a-abe8-250f2a131bab req-85e456e1-d040-4345-a43f-734146dc7e67 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033049 Aug 03 13:16:42.869274 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 625/1253] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:17:47.606451 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:47.607350 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:47.611544 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-cfdc8f6b-3df1-4f22-bb8a-979aa0386bee tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:17:47.616050 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-cfdc8f6b-3df1-4f22-bb8a-979aa0386bee tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:17:47.618117 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-cfdc8f6b-3df1-4f22-bb8a-979aa0386bee tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:17:47.618605 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-cfdc8f6b-3df1-4f22-bb8a-979aa0386bee tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:17:47.619436 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-cfdc8f6b-3df1-4f22-bb8a-979aa0386bee tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:17:47.619879 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-cfdc8f6b-3df1-4f22-bb8a-979aa0386bee tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:17:47.644496 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-cfdc8f6b-3df1-4f22-bb8a-979aa0386bee tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b/ips" status: 200 len: 145 microversion: 2.1 time: 0.040168 Aug 03 13:17:47.645058 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 629/1254] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Aug 3 13:17:47 2022] GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:17:49.174853 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:49.175986 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=68 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:49.180611 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-1861403e-64f4-4381-ae1a-933c7450476b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee3e013d-bb4e-4af5-8e7c-dc1a3e28f775"}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:17:49.183021 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-1861403e-64f4-4381-ae1a-933c7450476b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:17:49.189045 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1861403e-64f4-4381-ae1a-933c7450476b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:17:49.189549 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1861403e-64f4-4381-ae1a-933c7450476b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:17:49.190256 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1861403e-64f4-4381-ae1a-933c7450476b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:17:49.190690 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-1861403e-64f4-4381-ae1a-933c7450476b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:17:49.844550 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-1861403e-64f4-4381-ae1a-933c7450476b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "POST /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.670839 Aug 03 13:17:49.845083 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 626/1255] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Aug 3 13:17:49 2022] POST /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b/os-volume_attachments => generated 194 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:17:57.355964 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-4b62eb37-88dd-4c7a-b3a1-2324283e13ca tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:17:57.358156 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-4b62eb37-88dd-4c7a-b3a1-2324283e13ca tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:17:57.365183 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4b62eb37-88dd-4c7a-b3a1-2324283e13ca tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:17:57.365637 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4b62eb37-88dd-4c7a-b3a1-2324283e13ca tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:17:57.366427 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4b62eb37-88dd-4c7a-b3a1-2324283e13ca tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:17:57.366897 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4b62eb37-88dd-4c7a-b3a1-2324283e13ca tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:17:57.396560 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-4b62eb37-88dd-4c7a-b3a1-2324283e13ca tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045358 Aug 03 13:17:57.397109 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 630/1256] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 3 13:17:57 2022] GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:17:57.408908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e4d442bc-5141-499b-b703-dcb6b603455b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:17:57.409493 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-e4d442bc-5141-499b-b703-dcb6b603455b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:17:57.416133 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e4d442bc-5141-499b-b703-dcb6b603455b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:17:57.416585 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e4d442bc-5141-499b-b703-dcb6b603455b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:17:57.417435 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e4d442bc-5141-499b-b703-dcb6b603455b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:17:57.417874 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e4d442bc-5141-499b-b703-dcb6b603455b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:17:57.446079 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-e4d442bc-5141-499b-b703-dcb6b603455b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b/os-volume_attachments/ee3e013d-bb4e-4af5-8e7c-dc1a3e28f775" status: 200 len: 194 microversion: 2.1 time: 0.042099 Aug 03 13:17:57.446664 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 627/1257] 10.222.0.64 () {58 vars in 1413 bytes} [Wed Aug 3 13:17:57 2022] GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b/os-volume_attachments/ee3e013d-bb4e-4af5-8e7c-dc1a3e28f775 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:17:57.457978 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 13:17:57.458145 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Wed Aug 3 13:17:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 13:17:59.028106 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-40cedf76-ac32-4d4e-946f-e85fdb1c4b94 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f910dae-dc1d-494f-99c8-293472cc18ba"}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:17:59.030475 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-40cedf76-ac32-4d4e-946f-e85fdb1c4b94 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:17:59.038137 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-40cedf76-ac32-4d4e-946f-e85fdb1c4b94 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:17:59.038590 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-40cedf76-ac32-4d4e-946f-e85fdb1c4b94 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:17:59.039388 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-40cedf76-ac32-4d4e-946f-e85fdb1c4b94 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:17:59.039822 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-40cedf76-ac32-4d4e-946f-e85fdb1c4b94 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:17:59.689381 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-40cedf76-ac32-4d4e-946f-e85fdb1c4b94 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "POST /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.665252 Aug 03 13:17:59.690014 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 631/1258] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Aug 3 13:17:59 2022] POST /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b/os-volume_attachments => generated 194 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:18:07.216251 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-7bd4d86e-5de7-4ddb-9a3b-79f9801f26e3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:07.218604 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-7bd4d86e-5de7-4ddb-9a3b-79f9801f26e3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:18:07.225585 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7bd4d86e-5de7-4ddb-9a3b-79f9801f26e3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:07.226058 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7bd4d86e-5de7-4ddb-9a3b-79f9801f26e3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:07.226862 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7bd4d86e-5de7-4ddb-9a3b-79f9801f26e3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:07.227293 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-7bd4d86e-5de7-4ddb-9a3b-79f9801f26e3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:07.256863 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-7bd4d86e-5de7-4ddb-9a3b-79f9801f26e3 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044670 Aug 03 13:18:07.257406 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 628/1259] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 3 13:18:07 2022] GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:18:07.404817 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-4e20b47f-7e78-4d58-a026-4bc0e4b6ff3d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:07.405491 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-4e20b47f-7e78-4d58-a026-4bc0e4b6ff3d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:18:07.412207 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4e20b47f-7e78-4d58-a026-4bc0e4b6ff3d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:07.412654 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4e20b47f-7e78-4d58-a026-4bc0e4b6ff3d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:07.413462 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4e20b47f-7e78-4d58-a026-4bc0e4b6ff3d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:07.413890 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4e20b47f-7e78-4d58-a026-4bc0e4b6ff3d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:07.443181 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-4e20b47f-7e78-4d58-a026-4bc0e4b6ff3d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b/os-volume_attachments/ee3e013d-bb4e-4af5-8e7c-dc1a3e28f775" status: 200 len: 194 microversion: 2.1 time: 0.043237 Aug 03 13:18:07.443743 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 632/1260] 10.222.0.64 () {58 vars in 1413 bytes} [Wed Aug 3 13:18:07 2022] GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b/os-volume_attachments/ee3e013d-bb4e-4af5-8e7c-dc1a3e28f775 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:18:07.454662 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-fd14a5cc-1fbc-496b-9250-cdefe0ebb328 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:07.455194 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-fd14a5cc-1fbc-496b-9250-cdefe0ebb328 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:18:07.461159 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fd14a5cc-1fbc-496b-9250-cdefe0ebb328 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:07.461613 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fd14a5cc-1fbc-496b-9250-cdefe0ebb328 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:07.462368 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fd14a5cc-1fbc-496b-9250-cdefe0ebb328 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:07.462831 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fd14a5cc-1fbc-496b-9250-cdefe0ebb328 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:07.541382 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-fd14a5cc-1fbc-496b-9250-cdefe0ebb328 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lazy-loading 'services' on Instance uuid 1cc55200-5481-4c78-9969-164d7a36be0b {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:18:07.696687 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-fd14a5cc-1fbc-496b-9250-cdefe0ebb328 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b/os-volume_attachments/ee3e013d-bb4e-4af5-8e7c-dc1a3e28f775" status: 202 len: 0 microversion: 2.1 time: 0.246300 Aug 03 13:18:07.697207 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 629/1261] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Aug 3 13:18:07 2022] DELETE /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b/os-volume_attachments/ee3e013d-bb4e-4af5-8e7c-dc1a3e28f775 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 13:18:09.868454 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-3feaf5a1-6ff6-4035-9059-f26c67e65bef tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:09.868954 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-3feaf5a1-6ff6-4035-9059-f26c67e65bef tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:18:09.875541 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3feaf5a1-6ff6-4035-9059-f26c67e65bef tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:09.875990 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3feaf5a1-6ff6-4035-9059-f26c67e65bef tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:09.877424 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3feaf5a1-6ff6-4035-9059-f26c67e65bef tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:09.877857 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-3feaf5a1-6ff6-4035-9059-f26c67e65bef tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:09.907407 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-3feaf5a1-6ff6-4035-9059-f26c67e65bef tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b/os-volume_attachments/5f910dae-dc1d-494f-99c8-293472cc18ba" status: 200 len: 194 microversion: 2.1 time: 0.042883 Aug 03 13:18:09.907990 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 633/1262] 10.222.0.64 () {58 vars in 1413 bytes} [Wed Aug 3 13:18:09 2022] GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b/os-volume_attachments/5f910dae-dc1d-494f-99c8-293472cc18ba => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:18:09.919593 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-17a29c37-351c-49f1-9f1e-2dcf2c4cb792 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:09.920166 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-17a29c37-351c-49f1-9f1e-2dcf2c4cb792 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:18:09.926959 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-17a29c37-351c-49f1-9f1e-2dcf2c4cb792 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:09.927407 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-17a29c37-351c-49f1-9f1e-2dcf2c4cb792 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:09.928160 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-17a29c37-351c-49f1-9f1e-2dcf2c4cb792 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:09.928591 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-17a29c37-351c-49f1-9f1e-2dcf2c4cb792 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:10.007113 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-17a29c37-351c-49f1-9f1e-2dcf2c4cb792 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lazy-loading 'services' on Instance uuid 1cc55200-5481-4c78-9969-164d7a36be0b {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:18:10.193330 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-17a29c37-351c-49f1-9f1e-2dcf2c4cb792 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b/os-volume_attachments/5f910dae-dc1d-494f-99c8-293472cc18ba" status: 202 len: 0 microversion: 2.1 time: 0.278312 Aug 03 13:18:10.193933 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 630/1263] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Aug 3 13:18:09 2022] DELETE /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b/os-volume_attachments/5f910dae-dc1d-494f-99c8-293472cc18ba => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 13:18:11.364960 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-96657a66-4ea7-4bb5-8f03-07802b29cdaf tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:11.367218 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-96657a66-4ea7-4bb5-8f03-07802b29cdaf tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:18:11.373765 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-96657a66-4ea7-4bb5-8f03-07802b29cdaf tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:11.374193 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-96657a66-4ea7-4bb5-8f03-07802b29cdaf tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:11.375019 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-96657a66-4ea7-4bb5-8f03-07802b29cdaf tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:11.375450 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-96657a66-4ea7-4bb5-8f03-07802b29cdaf tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:11.407289 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-96657a66-4ea7-4bb5-8f03-07802b29cdaf tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046706 Aug 03 13:18:11.407757 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 634/1264] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 3 13:18:11 2022] GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 13:18:11.519146 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-815bc73f-4756-4790-80c0-14b947f84e9d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:11.521417 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-815bc73f-4756-4790-80c0-14b947f84e9d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:18:11.527678 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-815bc73f-4756-4790-80c0-14b947f84e9d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:11.528131 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-815bc73f-4756-4790-80c0-14b947f84e9d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:11.528891 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-815bc73f-4756-4790-80c0-14b947f84e9d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:11.529329 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-815bc73f-4756-4790-80c0-14b947f84e9d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:11.557524 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-815bc73f-4756-4790-80c0-14b947f84e9d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043128 Aug 03 13:18:11.558079 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 631/1265] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 3 13:18:11 2022] GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 13:18:11.618610 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-a1f8e5a5-2027-493d-9536-a0125ca6884d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:11.619147 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-a1f8e5a5-2027-493d-9536-a0125ca6884d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:18:11.625339 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a1f8e5a5-2027-493d-9536-a0125ca6884d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:11.625875 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a1f8e5a5-2027-493d-9536-a0125ca6884d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:11.627359 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a1f8e5a5-2027-493d-9536-a0125ca6884d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:11.627796 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-a1f8e5a5-2027-493d-9536-a0125ca6884d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:11.652358 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-a1f8e5a5-2027-493d-9536-a0125ca6884d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Going to try to terminate instance {{(pid=119409) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 13:18:11.890960 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-a1f8e5a5-2027-493d-9536-a0125ca6884d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b" status: 204 len: 0 microversion: 2.1 time: 0.275873 Aug 03 13:18:11.891584 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 635/1266] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 3 13:18:11 2022] DELETE /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 13:18:11.900139 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-ddf2a713-492d-4011-9c5c-fdb031aa9257 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:11.900775 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-ddf2a713-492d-4011-9c5c-fdb031aa9257 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:18:11.906803 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ddf2a713-492d-4011-9c5c-fdb031aa9257 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:11.907251 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ddf2a713-492d-4011-9c5c-fdb031aa9257 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:11.908022 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ddf2a713-492d-4011-9c5c-fdb031aa9257 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:11.908479 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ddf2a713-492d-4011-9c5c-fdb031aa9257 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:12.036206 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-ddf2a713-492d-4011-9c5c-fdb031aa9257 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:18:12.043821 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-ddf2a713-492d-4011-9c5c-fdb031aa9257 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b" status: 200 len: 1672 microversion: 2.1 time: 0.147550 Aug 03 13:18:12.044385 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 632/1267] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:18:11 2022] GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:18:13.066687 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-93514a01-85e3-4072-9500-04c725fa08c4 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:13.067426 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-93514a01-85e3-4072-9500-04c725fa08c4 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:18:13.074121 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-93514a01-85e3-4072-9500-04c725fa08c4 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:13.074571 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-93514a01-85e3-4072-9500-04c725fa08c4 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:13.075380 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-93514a01-85e3-4072-9500-04c725fa08c4 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:13.075815 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-93514a01-85e3-4072-9500-04c725fa08c4 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:13.210421 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-93514a01-85e3-4072-9500-04c725fa08c4 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:18:13.217978 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-93514a01-85e3-4072-9500-04c725fa08c4 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b" status: 200 len: 1672 microversion: 2.1 time: 0.156042 Aug 03 13:18:13.218475 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 636/1268] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:18:13 2022] GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:18:14.239015 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-df8ccc36-3fba-41b8-9d05-3ad896f014a8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:14.239667 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-df8ccc36-3fba-41b8-9d05-3ad896f014a8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:18:14.246090 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-df8ccc36-3fba-41b8-9d05-3ad896f014a8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:14.246545 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-df8ccc36-3fba-41b8-9d05-3ad896f014a8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:14.247356 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-df8ccc36-3fba-41b8-9d05-3ad896f014a8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:14.247825 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-df8ccc36-3fba-41b8-9d05-3ad896f014a8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:14.377588 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-df8ccc36-3fba-41b8-9d05-3ad896f014a8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:18:14.385158 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-df8ccc36-3fba-41b8-9d05-3ad896f014a8 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b" status: 200 len: 1672 microversion: 2.1 time: 0.150109 Aug 03 13:18:14.385736 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 633/1269] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:18:14 2022] GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:18:14.955808 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-840eab7d-de58-40ba-bbd5-fda188079282 req-74717fb4-9da6-44e1-b5f6-4f960898a740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cc55200-5481-4c78-9969-164d7a36be0b", "name": "network-vif-deleted", "tag": "86a30b5b-5124-4720-86c9-56d135755579"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:18:14.966015 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-840eab7d-de58-40ba-bbd5-fda188079282 req-74717fb4-9da6-44e1-b5f6-4f960898a740 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:14.966452 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-840eab7d-de58-40ba-bbd5-fda188079282 req-74717fb4-9da6-44e1-b5f6-4f960898a740 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:14.978553 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-840eab7d-de58-40ba-bbd5-fda188079282 req-74717fb4-9da6-44e1-b5f6-4f960898a740 service nova] Creating event network-vif-deleted:86a30b5b-5124-4720-86c9-56d135755579 for instance 1cc55200-5481-4c78-9969-164d7a36be0b on hv-cinder-85083 Aug 03 13:18:14.983945 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-840eab7d-de58-40ba-bbd5-fda188079282 req-74717fb4-9da6-44e1-b5f6-4f960898a740 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032600 Aug 03 13:18:14.984541 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 637/1270] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:18:15.405814 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-731a40f6-57b1-4317-b249-25cdd35ddd5a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:15.406424 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-731a40f6-57b1-4317-b249-25cdd35ddd5a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:18:15.415139 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-731a40f6-57b1-4317-b249-25cdd35ddd5a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:15.415589 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-731a40f6-57b1-4317-b249-25cdd35ddd5a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:15.416364 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-731a40f6-57b1-4317-b249-25cdd35ddd5a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:15.416799 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-731a40f6-57b1-4317-b249-25cdd35ddd5a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:15.449858 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-731a40f6-57b1-4317-b249-25cdd35ddd5a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:15.450567 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-731a40f6-57b1-4317-b249-25cdd35ddd5a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:15.451071 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-731a40f6-57b1-4317-b249-25cdd35ddd5a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lazy-loading 'fault' on Instance uuid 1cc55200-5481-4c78-9969-164d7a36be0b {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:18:15.492675 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-731a40f6-57b1-4317-b249-25cdd35ddd5a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90109591e9cd43b9aab0fe5b1593e9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965502bfffde4ee19c6bd7ea81f08672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:18:15.500238 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-731a40f6-57b1-4317-b249-25cdd35ddd5a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b" status: 200 len: 1326 microversion: 2.1 time: 0.098156 Aug 03 13:18:15.500885 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 634/1271] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:18:15 2022] GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b => generated 1326 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:18:16.521981 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-bf7cb70b-311c-43fa-b913-69d39c50631a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:16.522677 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-bf7cb70b-311c-43fa-b913-69d39c50631a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:18:16.529337 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bf7cb70b-311c-43fa-b913-69d39c50631a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:16.529775 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bf7cb70b-311c-43fa-b913-69d39c50631a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:16.530522 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bf7cb70b-311c-43fa-b913-69d39c50631a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:16.530977 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-bf7cb70b-311c-43fa-b913-69d39c50631a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:16.543979 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-bf7cb70b-311c-43fa-b913-69d39c50631a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] HTTP exception thrown: Instance 1cc55200-5481-4c78-9969-164d7a36be0b could not be found. Aug 03 13:18:16.545581 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-bf7cb70b-311c-43fa-b913-69d39c50631a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Request method failure captured: Aug 03 13:18:16.545581 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b HTTP/1.1 Aug 03 13:18:16.545581 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 13:18:16.545581 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 13:18:16.545581 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 13:18:16.545581 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 0 Aug 03 13:18:16.545581 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 13:18:16.545581 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 13:18:16.545581 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 13:18:16.545581 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 13:18:16.545581 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nQHZGJ5uDuXP1tWz-tHGbmAQk2UsQ7n-jqFev-gLzu9A9iFbbGEDXzK1sa40OnntU82Hi4myrQ7yJ5KWMHj2qMG0ZJOpqstT4meiCUKrBmnmB3YHFxGhI3oNUqTkqviPM5768fPkKxnVrC6w3tZLuCzcxWg8RNVn0WJi8ikdBM_QFE Aug 03 13:18:16.545581 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 13:18:16.545581 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 13:18:16.545581 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 13:18:16.545581 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 13:18:16.545581 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 13:18:16.545581 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 13:18:16.545581 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: 965502bfffde4ee19c6bd7ea81f08672 Aug 03 13:18:16.545581 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-AttachVolumeTestJSON-1928055744 Aug 03 13:18:16.545581 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 13:18:16.545581 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 13:18:16.547327 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/965502bfffde4ee19c6bd7ea81f08672"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/965502bfffde4ee19c6bd7ea81f08672"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/965502bfffde4ee19c6bd7ea81f08672"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_965502bfffde4ee19c6bd7ea81f08672", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:18:16.547327 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-AttachVolumeTestJSON-1928055744 Aug 03 13:18:16.547327 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: 965502bfffde4ee19c6bd7ea81f08672 Aug 03 13:18:16.547327 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1928055744 Aug 03 13:18:16.547327 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-AttachVolumeTestJSON-1928055744-project Aug 03 13:18:16.547327 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 13:18:16.547327 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 13:18:16.547327 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: 90109591e9cd43b9aab0fe5b1593e9dd Aug 03 13:18:16.547327 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-AttachVolumeTestJSON-1928055744-project Aug 03 13:18:16.547327 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: > Aug 03 13:18:16.547327 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Instance 1cc55200-5481-4c78-9969-164d7a36be0b could not be found. Aug 03 13:18:16.547327 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'id': '1cc55200-5481-4c78-9969-164d7a36be0b'} Aug 03 13:18:16.548953 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:18:16.548953 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:16.548953 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:18:16.548953 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:18:16.548953 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:18:16.548953 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:18:16.548953 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:18:16.548953 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:18:16.548953 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:18:16.548953 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:18:16.548953 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cc55200-5481-4c78-9969-164d7a36be0b could not be found. Aug 03 13:18:16.548953 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:18:16.548953 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:18:16.548953 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:18:16.548953 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:16.548953 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:18:16.548953 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:18:16.548953 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:18:16.548953 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:18:16.548953 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:18:16.550533 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:18:16.550533 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:18:16.550533 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:18:16.550533 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:18:16.550533 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:18:16.550533 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:18:16.550533 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:18:16.550533 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cc55200-5481-4c78-9969-164d7a36be0b could not be found. Aug 03 13:18:16.550533 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:18:16.550533 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:18:16.550533 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:18:16.550533 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:16.550533 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:18:16.550533 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:18:16.550533 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:18:16.550533 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:18:16.550533 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cc55200-5481-4c78-9969-164d7a36be0b could not be found. Aug 03 13:18:16.550533 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:18:16.552292 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-bf7cb70b-311c-43fa-b913-69d39c50631a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Returning 404 to user: Instance 1cc55200-5481-4c78-9969-164d7a36be0b could not be found. {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:18:16.552292 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-bf7cb70b-311c-43fa-b913-69d39c50631a tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b" status: 404 len: 111 microversion: 2.1 time: 0.029105 Aug 03 13:18:16.552292 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 638/1272] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:18:16 2022] GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:18:16.556157 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-48210119-4ab2-46f6-a5c9-bb9404835c60 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '.version_select at 0x7fe6cbeabf70>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:16.624006 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-48210119-4ab2-46f6-a5c9-bb9404835c60 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1035187641" status: 202 len: 0 microversion: 2.1 time: 0.071609 Aug 03 13:18:16.624579 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 635/1273] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Aug 3 13:18:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1035187641 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 13:18:19.867459 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-49f60fc2-1171-4c4d-8f7f-f48aee30798d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:19.867962 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-49f60fc2-1171-4c4d-8f7f-f48aee30798d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:18:19.874358 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-49f60fc2-1171-4c4d-8f7f-f48aee30798d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:19.874835 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-49f60fc2-1171-4c4d-8f7f-f48aee30798d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:19.875601 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-49f60fc2-1171-4c4d-8f7f-f48aee30798d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:19.876036 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-49f60fc2-1171-4c4d-8f7f-f48aee30798d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:19.889771 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-49f60fc2-1171-4c4d-8f7f-f48aee30798d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] HTTP exception thrown: Instance 1cc55200-5481-4c78-9969-164d7a36be0b could not be found. Aug 03 13:18:19.891311 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-49f60fc2-1171-4c4d-8f7f-f48aee30798d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Request method failure captured: Aug 03 13:18:19.891311 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: DELETE /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b HTTP/1.1 Aug 03 13:18:19.891311 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 13:18:19.891311 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 13:18:19.891311 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 13:18:19.891311 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 0 Aug 03 13:18:19.891311 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 13:18:19.891311 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 13:18:19.891311 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 13:18:19.891311 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 13:18:19.891311 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nQHZGJ5uDuXP1tWz-tHGbmAQk2UsQ7n-jqFev-gLzu9A9iFbbGEDXzK1sa40OnntU82Hi4myrQ7yJ5KWMHj2qMG0ZJOpqstT4meiCUKrBmnmB3YHFxGhI3oNUqTkqviPM5768fPkKxnVrC6w3tZLuCzcxWg8RNVn0WJi8ikdBM_QFE Aug 03 13:18:19.891311 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 13:18:19.891311 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 13:18:19.891311 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 13:18:19.891311 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 13:18:19.891311 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 13:18:19.891311 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 13:18:19.891311 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: 965502bfffde4ee19c6bd7ea81f08672 Aug 03 13:18:19.891311 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-AttachVolumeTestJSON-1928055744 Aug 03 13:18:19.891311 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 13:18:19.891311 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 13:18:19.893590 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/965502bfffde4ee19c6bd7ea81f08672"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/965502bfffde4ee19c6bd7ea81f08672"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/965502bfffde4ee19c6bd7ea81f08672"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_965502bfffde4ee19c6bd7ea81f08672", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:18:19.893590 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-AttachVolumeTestJSON-1928055744 Aug 03 13:18:19.893590 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: 965502bfffde4ee19c6bd7ea81f08672 Aug 03 13:18:19.893590 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1928055744 Aug 03 13:18:19.893590 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-AttachVolumeTestJSON-1928055744-project Aug 03 13:18:19.893590 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 13:18:19.893590 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 13:18:19.893590 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: 90109591e9cd43b9aab0fe5b1593e9dd Aug 03 13:18:19.893590 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-AttachVolumeTestJSON-1928055744-project Aug 03 13:18:19.893590 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: > Aug 03 13:18:19.893590 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Instance 1cc55200-5481-4c78-9969-164d7a36be0b could not be found. Aug 03 13:18:19.893590 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'id': '1cc55200-5481-4c78-9969-164d7a36be0b'} Aug 03 13:18:19.894905 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:18:19.894905 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:19.894905 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:18:19.894905 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:18:19.894905 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:18:19.894905 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:18:19.894905 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:18:19.894905 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:18:19.894905 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:18:19.894905 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:18:19.894905 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cc55200-5481-4c78-9969-164d7a36be0b could not be found. Aug 03 13:18:19.894905 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:18:19.894905 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:18:19.894905 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:18:19.894905 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:19.894905 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:18:19.894905 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:18:19.894905 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:18:19.894905 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:18:19.894905 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:18:19.896376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:18:19.896376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 13:18:19.896376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 13:18:19.896376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 13:18:19.896376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 13:18:19.896376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:18:19.896376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:18:19.896376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:18:19.896376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:18:19.896376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cc55200-5481-4c78-9969-164d7a36be0b could not be found. Aug 03 13:18:19.896376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:18:19.896376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:18:19.896376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:18:19.896376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:19.896376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:18:19.896376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:18:19.896376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:18:19.896376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:18:19.896376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cc55200-5481-4c78-9969-164d7a36be0b could not be found. Aug 03 13:18:19.896376 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:18:19.897838 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-49f60fc2-1171-4c4d-8f7f-f48aee30798d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Returning 404 to user: Instance 1cc55200-5481-4c78-9969-164d7a36be0b could not be found. {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:18:19.897838 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-49f60fc2-1171-4c4d-8f7f-f48aee30798d tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b" status: 404 len: 111 microversion: 2.1 time: 0.029633 Aug 03 13:18:19.897838 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 639/1274] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 3 13:18:19 2022] DELETE /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:18:19.901572 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-ca8ac45e-1aae-4794-9d7e-eed87556b977 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:19.902187 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-ca8ac45e-1aae-4794-9d7e-eed87556b977 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 1cc55200-5481-4c78-9969-164d7a36be0b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:18:19.904819 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:19.910464 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ca8ac45e-1aae-4794-9d7e-eed87556b977 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:19.910945 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ca8ac45e-1aae-4794-9d7e-eed87556b977 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:19.911702 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ca8ac45e-1aae-4794-9d7e-eed87556b977 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:19.912137 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-ca8ac45e-1aae-4794-9d7e-eed87556b977 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:19.916017 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:19.925010 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.wsgi [None req-ca8ac45e-1aae-4794-9d7e-eed87556b977 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] HTTP exception thrown: Instance 1cc55200-5481-4c78-9969-164d7a36be0b could not be found. Aug 03 13:18:19.926604 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-ca8ac45e-1aae-4794-9d7e-eed87556b977 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Request method failure captured: Aug 03 13:18:19.926604 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: request: GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b HTTP/1.1 Aug 03 13:18:19.926604 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept: application/json Aug 03 13:18:19.926604 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept-Encoding: identity Aug 03 13:18:19.926604 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Connection: close Aug 03 13:18:19.926604 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Length: 0 Aug 03 13:18:19.926604 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Type: application/json Aug 03 13:18:19.926604 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Host: 10.222.0.64 Aug 03 13:18:19.926604 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Openstack-System-Scope: None Aug 03 13:18:19.926604 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: User-Agent: python-urllib3/1.26.10 Aug 03 13:18:19.926604 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Auth-Token: gAAAAABi6nQHZGJ5uDuXP1tWz-tHGbmAQk2UsQ7n-jqFev-gLzu9A9iFbbGEDXzK1sa40OnntU82Hi4myrQ7yJ5KWMHj2qMG0ZJOpqstT4meiCUKrBmnmB3YHFxGhI3oNUqTkqviPM5768fPkKxnVrC6w3tZLuCzcxWg8RNVn0WJi8ikdBM_QFE Aug 03 13:18:19.926604 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Id: None Aug 03 13:18:19.926604 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Name: None Aug 03 13:18:19.926604 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Identity-Status: Confirmed Aug 03 13:18:19.926604 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Is-Admin-Project: True Aug 03 13:18:19.926604 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Id: default Aug 03 13:18:19.926604 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Name: Default Aug 03 13:18:19.926604 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Id: 965502bfffde4ee19c6bd7ea81f08672 Aug 03 13:18:19.926604 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Name: tempest-AttachVolumeTestJSON-1928055744 Aug 03 13:18:19.926604 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Role: member,reader Aug 03 13:18:19.926604 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Roles: member,reader Aug 03 13:18:19.928168 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/965502bfffde4ee19c6bd7ea81f08672"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/965502bfffde4ee19c6bd7ea81f08672"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/965502bfffde4ee19c6bd7ea81f08672"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_965502bfffde4ee19c6bd7ea81f08672", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:18:19.928168 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant: tempest-AttachVolumeTestJSON-1928055744 Aug 03 13:18:19.928168 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Id: 965502bfffde4ee19c6bd7ea81f08672 Aug 03 13:18:19.928168 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1928055744 Aug 03 13:18:19.928168 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User: tempest-AttachVolumeTestJSON-1928055744-project Aug 03 13:18:19.928168 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Id: default Aug 03 13:18:19.928168 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Name: Default Aug 03 13:18:19.928168 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Id: 90109591e9cd43b9aab0fe5b1593e9dd Aug 03 13:18:19.928168 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Name: tempest-AttachVolumeTestJSON-1928055744-project Aug 03 13:18:19.928168 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: method: > Aug 03 13:18:19.928168 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: exception: Instance 1cc55200-5481-4c78-9969-164d7a36be0b could not be found. Aug 03 13:18:19.928168 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: action_args: {'id': '1cc55200-5481-4c78-9969-164d7a36be0b'} Aug 03 13:18:19.930002 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:18:19.930002 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:19.930002 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:18:19.930002 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:18:19.930002 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:18:19.930002 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:18:19.930002 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:18:19.930002 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:18:19.930002 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:18:19.930002 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:18:19.930002 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cc55200-5481-4c78-9969-164d7a36be0b could not be found. Aug 03 13:18:19.930002 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:18:19.930002 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:18:19.930002 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:18:19.930002 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:19.930002 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:18:19.930002 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:18:19.930002 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:18:19.930002 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:18:19.930002 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:18:19.932017 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:18:19.932017 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:18:19.932017 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:18:19.932017 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:18:19.932017 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:18:19.932017 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:18:19.932017 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:18:19.932017 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cc55200-5481-4c78-9969-164d7a36be0b could not be found. Aug 03 13:18:19.932017 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:18:19.932017 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:18:19.932017 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:18:19.932017 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:19.932017 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:18:19.932017 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:18:19.932017 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:18:19.932017 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:18:19.932017 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cc55200-5481-4c78-9969-164d7a36be0b could not be found. Aug 03 13:18:19.932017 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:18:19.933417 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-ca8ac45e-1aae-4794-9d7e-eed87556b977 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Returning 404 to user: Instance 1cc55200-5481-4c78-9969-164d7a36be0b could not be found. {{(pid=119410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:18:19.933417 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-ca8ac45e-1aae-4794-9d7e-eed87556b977 tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b" status: 404 len: 111 microversion: 2.1 time: 0.030304 Aug 03 13:18:19.933417 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 636/1275] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:18:19 2022] GET /compute/v2.1/servers/1cc55200-5481-4c78-9969-164d7a36be0b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:18:21.190336 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d9c628ea-d0fb-40f6-abe4-25ccf8cdec6b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:21.190860 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-d9c628ea-d0fb-40f6-abe4-25ccf8cdec6b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:18:21.197309 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d9c628ea-d0fb-40f6-abe4-25ccf8cdec6b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:21.197755 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d9c628ea-d0fb-40f6-abe4-25ccf8cdec6b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:21.198512 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d9c628ea-d0fb-40f6-abe4-25ccf8cdec6b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:21.198970 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d9c628ea-d0fb-40f6-abe4-25ccf8cdec6b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:21.212011 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-d9c628ea-d0fb-40f6-abe4-25ccf8cdec6b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] HTTP exception thrown: Instance 327747f6-507a-42b7-a7bc-56b2947b0d25 could not be found. Aug 03 13:18:21.213524 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d9c628ea-d0fb-40f6-abe4-25ccf8cdec6b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Request method failure captured: Aug 03 13:18:21.213524 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: DELETE /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 HTTP/1.1 Aug 03 13:18:21.213524 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 13:18:21.213524 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 13:18:21.213524 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 13:18:21.213524 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 0 Aug 03 13:18:21.213524 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 13:18:21.213524 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 13:18:21.213524 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 13:18:21.213524 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 13:18:21.213524 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nQHZGJ5uDuXP1tWz-tHGbmAQk2UsQ7n-jqFev-gLzu9A9iFbbGEDXzK1sa40OnntU82Hi4myrQ7yJ5KWMHj2qMG0ZJOpqstT4meiCUKrBmnmB3YHFxGhI3oNUqTkqviPM5768fPkKxnVrC6w3tZLuCzcxWg8RNVn0WJi8ikdBM_QFE Aug 03 13:18:21.213524 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 13:18:21.213524 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 13:18:21.213524 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 13:18:21.213524 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 13:18:21.213524 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 13:18:21.213524 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 13:18:21.213524 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: 965502bfffde4ee19c6bd7ea81f08672 Aug 03 13:18:21.213524 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-AttachVolumeTestJSON-1928055744 Aug 03 13:18:21.213524 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 13:18:21.213524 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 13:18:21.215214 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/965502bfffde4ee19c6bd7ea81f08672"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/965502bfffde4ee19c6bd7ea81f08672"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/965502bfffde4ee19c6bd7ea81f08672"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_965502bfffde4ee19c6bd7ea81f08672", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:18:21.215214 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-AttachVolumeTestJSON-1928055744 Aug 03 13:18:21.215214 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: 965502bfffde4ee19c6bd7ea81f08672 Aug 03 13:18:21.215214 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1928055744 Aug 03 13:18:21.215214 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-AttachVolumeTestJSON-1928055744-project Aug 03 13:18:21.215214 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 13:18:21.215214 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 13:18:21.215214 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: 90109591e9cd43b9aab0fe5b1593e9dd Aug 03 13:18:21.215214 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-AttachVolumeTestJSON-1928055744-project Aug 03 13:18:21.215214 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: > Aug 03 13:18:21.215214 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Instance 327747f6-507a-42b7-a7bc-56b2947b0d25 could not be found. Aug 03 13:18:21.215214 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'id': '327747f6-507a-42b7-a7bc-56b2947b0d25'} Aug 03 13:18:21.216135 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:18:21.216135 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:21.216135 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:18:21.216135 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:18:21.216135 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:18:21.216135 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:18:21.216135 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:18:21.216135 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:18:21.216135 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:18:21.216135 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:18:21.216135 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 327747f6-507a-42b7-a7bc-56b2947b0d25 could not be found. Aug 03 13:18:21.216135 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:18:21.216135 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:18:21.216135 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:18:21.216135 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:21.216135 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:18:21.216135 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:18:21.216135 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:18:21.216135 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:18:21.216135 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:18:21.217762 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:18:21.217762 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 13:18:21.217762 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 13:18:21.217762 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 13:18:21.217762 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 13:18:21.217762 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:18:21.217762 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:18:21.217762 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:18:21.217762 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:18:21.217762 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 327747f6-507a-42b7-a7bc-56b2947b0d25 could not be found. Aug 03 13:18:21.217762 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:18:21.217762 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:18:21.217762 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:18:21.217762 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:21.217762 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:18:21.217762 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:18:21.217762 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:18:21.217762 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:18:21.217762 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 327747f6-507a-42b7-a7bc-56b2947b0d25 could not be found. Aug 03 13:18:21.217762 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:18:21.219438 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d9c628ea-d0fb-40f6-abe4-25ccf8cdec6b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Returning 404 to user: Instance 327747f6-507a-42b7-a7bc-56b2947b0d25 could not be found. {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:18:21.219438 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-d9c628ea-d0fb-40f6-abe4-25ccf8cdec6b tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "DELETE /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 404 len: 111 microversion: 2.1 time: 0.029047 Aug 03 13:18:21.219438 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 640/1276] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 3 13:18:21 2022] DELETE /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:18:21.223631 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-917affe8-c212-4fd7-82e4-dc47e97f982f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:21.224272 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-917affe8-c212-4fd7-82e4-dc47e97f982f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] [instance: 327747f6-507a-42b7-a7bc-56b2947b0d25] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:18:21.231857 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-917affe8-c212-4fd7-82e4-dc47e97f982f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:21.232256 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-917affe8-c212-4fd7-82e4-dc47e97f982f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:21.233018 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-917affe8-c212-4fd7-82e4-dc47e97f982f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:18:21.233455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-917affe8-c212-4fd7-82e4-dc47e97f982f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:18:21.246925 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.wsgi [None req-917affe8-c212-4fd7-82e4-dc47e97f982f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] HTTP exception thrown: Instance 327747f6-507a-42b7-a7bc-56b2947b0d25 could not be found. Aug 03 13:18:21.248455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-917affe8-c212-4fd7-82e4-dc47e97f982f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Request method failure captured: Aug 03 13:18:21.248455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: request: GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 HTTP/1.1 Aug 03 13:18:21.248455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept: application/json Aug 03 13:18:21.248455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept-Encoding: identity Aug 03 13:18:21.248455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Connection: close Aug 03 13:18:21.248455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Length: 0 Aug 03 13:18:21.248455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Type: application/json Aug 03 13:18:21.248455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Host: 10.222.0.64 Aug 03 13:18:21.248455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Openstack-System-Scope: None Aug 03 13:18:21.248455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: User-Agent: python-urllib3/1.26.10 Aug 03 13:18:21.248455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Auth-Token: gAAAAABi6nQHZGJ5uDuXP1tWz-tHGbmAQk2UsQ7n-jqFev-gLzu9A9iFbbGEDXzK1sa40OnntU82Hi4myrQ7yJ5KWMHj2qMG0ZJOpqstT4meiCUKrBmnmB3YHFxGhI3oNUqTkqviPM5768fPkKxnVrC6w3tZLuCzcxWg8RNVn0WJi8ikdBM_QFE Aug 03 13:18:21.248455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Id: None Aug 03 13:18:21.248455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Name: None Aug 03 13:18:21.248455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Identity-Status: Confirmed Aug 03 13:18:21.248455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Is-Admin-Project: True Aug 03 13:18:21.248455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Id: default Aug 03 13:18:21.248455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Name: Default Aug 03 13:18:21.248455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Id: 965502bfffde4ee19c6bd7ea81f08672 Aug 03 13:18:21.248455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Name: tempest-AttachVolumeTestJSON-1928055744 Aug 03 13:18:21.248455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Role: member,reader Aug 03 13:18:21.248455 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Roles: member,reader Aug 03 13:18:21.250113 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/965502bfffde4ee19c6bd7ea81f08672"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/965502bfffde4ee19c6bd7ea81f08672"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/965502bfffde4ee19c6bd7ea81f08672"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_965502bfffde4ee19c6bd7ea81f08672", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:18:21.250113 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant: tempest-AttachVolumeTestJSON-1928055744 Aug 03 13:18:21.250113 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Id: 965502bfffde4ee19c6bd7ea81f08672 Aug 03 13:18:21.250113 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1928055744 Aug 03 13:18:21.250113 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User: tempest-AttachVolumeTestJSON-1928055744-project Aug 03 13:18:21.250113 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Id: default Aug 03 13:18:21.250113 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Name: Default Aug 03 13:18:21.250113 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Id: 90109591e9cd43b9aab0fe5b1593e9dd Aug 03 13:18:21.250113 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Name: tempest-AttachVolumeTestJSON-1928055744-project Aug 03 13:18:21.250113 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: method: > Aug 03 13:18:21.250113 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: exception: Instance 327747f6-507a-42b7-a7bc-56b2947b0d25 could not be found. Aug 03 13:18:21.250113 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: action_args: {'id': '327747f6-507a-42b7-a7bc-56b2947b0d25'} Aug 03 13:18:21.250971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:18:21.250971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:21.250971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:18:21.250971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:18:21.250971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:18:21.250971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:18:21.250971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:18:21.250971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:18:21.250971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:18:21.250971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:18:21.250971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 327747f6-507a-42b7-a7bc-56b2947b0d25 could not be found. Aug 03 13:18:21.250971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:18:21.250971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:18:21.250971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:18:21.250971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:21.250971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:18:21.250971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:18:21.250971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:18:21.250971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:18:21.250971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:18:21.252971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:18:21.252971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:18:21.252971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:18:21.252971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:18:21.252971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:18:21.252971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:18:21.252971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:18:21.252971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 327747f6-507a-42b7-a7bc-56b2947b0d25 could not be found. Aug 03 13:18:21.252971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:18:21.252971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:18:21.252971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:18:21.252971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:21.252971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:18:21.252971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:18:21.252971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:18:21.252971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:18:21.252971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 327747f6-507a-42b7-a7bc-56b2947b0d25 could not be found. Aug 03 13:18:21.252971 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:18:21.254190 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-917affe8-c212-4fd7-82e4-dc47e97f982f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] Returning 404 to user: Instance 327747f6-507a-42b7-a7bc-56b2947b0d25 could not be found. {{(pid=119410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:18:21.254190 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-917affe8-c212-4fd7-82e4-dc47e97f982f tempest-AttachVolumeTestJSON-1928055744 tempest-AttachVolumeTestJSON-1928055744-project] 10.222.0.64 "GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25" status: 404 len: 111 microversion: 2.1 time: 0.030444 Aug 03 13:18:21.254190 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 637/1277] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:18:21 2022] GET /compute/v2.1/servers/327747f6-507a-42b7-a7bc-56b2947b0d25 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:18:26.650832 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-f5215a13-2f8e-4de0-9d74-5d0968cb3b8d tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] Action: 'create', calling method: .version_select at 0x7fe6d80d9700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-737783057"}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:18:27.221226 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-f5215a13-2f8e-4de0-9d74-5d0968cb3b8d tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.684446 Aug 03 13:18:27.221828 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 641/1278] 10.222.0.64 () {60 vars in 1155 bytes} [Wed Aug 3 13:18:26 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 686 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 03 13:18:27.234468 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-dccd6b2a-c6ab-4948-a277-527dd6c9b9b7 tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] Calling method '.version_select at 0x7fe6d80dd670>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:27.286599 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-dccd6b2a-c6ab-4948-a277-527dd6c9b9b7 tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/47d79f47-d762-4cb9-9740-9f4ab9a62964" status: 200 len: 344 microversion: 2.1 time: 0.055882 Aug 03 13:18:27.287196 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 638/1279] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Aug 3 13:18:27 2022] GET /compute/v2.1/os-volumes/47d79f47-d762-4cb9-9740-9f4ab9a62964 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:18:28.301902 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ca030a94-f537-4f08-b9a6-4eb1cb668d4c tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] Calling method '.version_select at 0x7fe6d80b0af0>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:28.349238 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-ca030a94-f537-4f08-b9a6-4eb1cb668d4c tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/47d79f47-d762-4cb9-9740-9f4ab9a62964" status: 200 len: 345 microversion: 2.1 time: 0.052428 Aug 03 13:18:28.349800 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 642/1280] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Aug 3 13:18:28 2022] GET /compute/v2.1/os-volumes/47d79f47-d762-4cb9-9740-9f4ab9a62964 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:18:28.363640 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e4487d3f-0ec3-4844-a386-049285b6c816 tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] Action: 'create', calling method: .version_select at 0x7fe6d80cc790>, body: {"snapshot": {"volume_id": "47d79f47-d762-4cb9-9740-9f4ab9a62964", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1140065511"}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:18:28.704565 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-e4487d3f-0ec3-4844-a386-049285b6c816 tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] 10.222.0.64 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.345623 Aug 03 13:18:28.705252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 639/1281] 10.222.0.64 () {60 vars in 1162 bytes} [Wed Aug 3 13:18:28 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:18:28.715856 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-6d74a6e5-8910-4a3a-9264-92b1f0d098b5 tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] Calling method '.version_select at 0x7fe6d82ec790>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:28.745148 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-6d74a6e5-8910-4a3a-9264-92b1f0d098b5 tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/68774c4a-12d8-4d48-86d4-096aa31f6a50" status: 200 len: 287 microversion: 2.1 time: 0.033092 Aug 03 13:18:28.745732 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 643/1282] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Aug 3 13:18:28 2022] GET /compute/v2.1/os-snapshots/68774c4a-12d8-4d48-86d4-096aa31f6a50 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:18:28.756540 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d34a833b-97f7-4d67-b13a-51e5c51f66f7 tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] Calling method '.version_select at 0x7fe6cbe26a60>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:28.789083 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d34a833b-97f7-4d67-b13a-51e5c51f66f7 tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.036210 Aug 03 13:18:28.789649 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 640/1283] 10.222.0.64 () {58 vars in 1140 bytes} [Wed Aug 3 13:18:28 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:18:28.800368 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-eb323da0-bda2-4c1e-af4d-c1db8ee5dcac tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] Calling method '.version_select at 0x7fe6d80d9dc0>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:28.831177 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-eb323da0-bda2-4c1e-af4d-c1db8ee5dcac tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/68774c4a-12d8-4d48-86d4-096aa31f6a50" status: 200 len: 287 microversion: 2.1 time: 0.032762 Aug 03 13:18:28.831177 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 644/1284] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Aug 3 13:18:28 2022] GET /compute/v2.1/os-snapshots/68774c4a-12d8-4d48-86d4-096aa31f6a50 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:18:29.842296 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-5982a75b-14c1-4cce-a8c1-e57f21b24b52 tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] Calling method '.version_select at 0x7fe6d8ae31f0>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:29.872441 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-5982a75b-14c1-4cce-a8c1-e57f21b24b52 tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/68774c4a-12d8-4d48-86d4-096aa31f6a50" status: 200 len: 287 microversion: 2.1 time: 0.033768 Aug 03 13:18:29.872995 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 641/1285] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Aug 3 13:18:29 2022] GET /compute/v2.1/os-snapshots/68774c4a-12d8-4d48-86d4-096aa31f6a50 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:18:30.885543 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-44ab3fc3-b343-4a57-ba22-68af920ce42e tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] Calling method '.version_select at 0x7fe6d81b9430>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:30.914564 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-44ab3fc3-b343-4a57-ba22-68af920ce42e tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/68774c4a-12d8-4d48-86d4-096aa31f6a50" status: 200 len: 287 microversion: 2.1 time: 0.033425 Aug 03 13:18:30.915144 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 645/1286] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Aug 3 13:18:30 2022] GET /compute/v2.1/os-snapshots/68774c4a-12d8-4d48-86d4-096aa31f6a50 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:18:31.927895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-0b360d57-8672-4385-9767-30178256a937 tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] Calling method '.version_select at 0x7fe6cbe8a310>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:31.956642 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-0b360d57-8672-4385-9767-30178256a937 tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/68774c4a-12d8-4d48-86d4-096aa31f6a50" status: 200 len: 287 microversion: 2.1 time: 0.033919 Aug 03 13:18:31.957206 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 642/1287] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Aug 3 13:18:31 2022] GET /compute/v2.1/os-snapshots/68774c4a-12d8-4d48-86d4-096aa31f6a50 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:18:32.966005 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:32.966819 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:32.971859 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-0fbba7fb-f8fe-4714-a5fd-25070c702ec4 tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] Calling method '.version_select at 0x7fe6d82ec160>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:33.001343 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-0fbba7fb-f8fe-4714-a5fd-25070c702ec4 tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/68774c4a-12d8-4d48-86d4-096aa31f6a50" status: 200 len: 288 microversion: 2.1 time: 0.036089 Aug 03 13:18:33.001939 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 646/1288] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Aug 3 13:18:32 2022] GET /compute/v2.1/os-snapshots/68774c4a-12d8-4d48-86d4-096aa31f6a50 => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:18:33.013387 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-7b441709-0cdd-407f-9df8-e983caffea1f tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] Calling method '.version_select at 0x7fe6cbe34430>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:33.125828 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-7b441709-0cdd-407f-9df8-e983caffea1f tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] 10.222.0.64 "DELETE /compute/v2.1/os-snapshots/68774c4a-12d8-4d48-86d4-096aa31f6a50" status: 202 len: 0 microversion: 2.1 time: 0.116603 Aug 03 13:18:33.126408 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 643/1289] 10.222.0.64 () {58 vars in 1254 bytes} [Wed Aug 3 13:18:33 2022] DELETE /compute/v2.1/os-snapshots/68774c4a-12d8-4d48-86d4-096aa31f6a50 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 13:18:33.134444 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-44d6e4f6-97a3-4fe6-9431-d9b4c0d943e2 tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] Calling method '.version_select at 0x7fe6d81b9310>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:33.166132 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-44d6e4f6-97a3-4fe6-9431-d9b4c0d943e2 tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/68774c4a-12d8-4d48-86d4-096aa31f6a50" status: 200 len: 287 microversion: 2.1 time: 0.035071 Aug 03 13:18:33.166489 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 647/1290] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Aug 3 13:18:33 2022] GET /compute/v2.1/os-snapshots/68774c4a-12d8-4d48-86d4-096aa31f6a50 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:18:34.179530 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-4f2198ec-098d-4f21-a203-3ee06a5a853f tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] Calling method '.version_select at 0x7fe6cbf4ad30>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:34.204428 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.wsgi [None req-4f2198ec-098d-4f21-a203-3ee06a5a853f tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] HTTP exception thrown: Snapshot 68774c4a-12d8-4d48-86d4-096aa31f6a50 could not be found. Aug 03 13:18:34.206906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-4f2198ec-098d-4f21-a203-3ee06a5a853f tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] Request method failure captured: Aug 03 13:18:34.206906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: request: GET /compute/v2.1/os-snapshots/68774c4a-12d8-4d48-86d4-096aa31f6a50 HTTP/1.1 Aug 03 13:18:34.206906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept: application/json Aug 03 13:18:34.206906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept-Encoding: identity Aug 03 13:18:34.206906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Connection: close Aug 03 13:18:34.206906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Length: 0 Aug 03 13:18:34.206906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Type: application/json Aug 03 13:18:34.206906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Host: 10.222.0.64 Aug 03 13:18:34.206906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Openstack-System-Scope: None Aug 03 13:18:34.206906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: User-Agent: python-urllib3/1.26.10 Aug 03 13:18:34.206906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Auth-Token: gAAAAABi6nWi2yllTy1etRSNC_2axktjwhb_zhTph3S4oGqAJqvok3OPNMnkQs2nolxlxMyvpKi0Hs6EgO8R2xpkhBRHqIJ-ua_6nL72WMfp_9ic4ZupSgOAXyzid3qCpylGkqadFuipt8hOdvg70Lzv3a8voZvCOrYLJdrKjwN4ZUhiEMK6D9k Aug 03 13:18:34.206906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Id: None Aug 03 13:18:34.206906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Name: None Aug 03 13:18:34.206906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Identity-Status: Confirmed Aug 03 13:18:34.206906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Is-Admin-Project: True Aug 03 13:18:34.206906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Id: default Aug 03 13:18:34.206906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Name: Default Aug 03 13:18:34.206906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Id: f6cc3c3890134449a4a63bd46f2430a5 Aug 03 13:18:34.206906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-812426814 Aug 03 13:18:34.206906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Role: member,reader Aug 03 13:18:34.206906 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Roles: member,reader Aug 03 13:18:34.208644 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f6cc3c3890134449a4a63bd46f2430a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f6cc3c3890134449a4a63bd46f2430a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f6cc3c3890134449a4a63bd46f2430a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f6cc3c3890134449a4a63bd46f2430a5", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:18:34.208644 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant: tempest-VolumesSnapshotsTestJSON-812426814 Aug 03 13:18:34.208644 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Id: f6cc3c3890134449a4a63bd46f2430a5 Aug 03 13:18:34.208644 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-812426814 Aug 03 13:18:34.208644 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User: tempest-VolumesSnapshotsTestJSON-812426814-project Aug 03 13:18:34.208644 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Id: default Aug 03 13:18:34.208644 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Name: Default Aug 03 13:18:34.208644 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Id: 3e3980ddaf444b4199f455ab270c3afd Aug 03 13:18:34.208644 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Name: tempest-VolumesSnapshotsTestJSON-812426814-project Aug 03 13:18:34.208644 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: method: Aug 03 13:18:34.208644 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: exception: Snapshot 68774c4a-12d8-4d48-86d4-096aa31f6a50 could not be found. Aug 03 13:18:34.208644 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: action_args: {'id': '68774c4a-12d8-4d48-86d4-096aa31f6a50'} Aug 03 13:18:34.208644 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:18:34.209724 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:34.209724 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 03 13:18:34.209724 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 03 13:18:34.209724 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 03 13:18:34.209724 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 03 13:18:34.209724 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 03 13:18:34.209724 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 03 13:18:34.209724 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 13:18:34.209724 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 13:18:34.209724 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 13:18:34.209724 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 13:18:34.209724 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 13:18:34.209724 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 13:18:34.209724 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 13:18:34.209724 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 13:18:34.209724 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 68774c4a-12d8-4d48-86d4-096aa31f6a50 could not be found. (HTTP 404) (Request-ID: req-05f97a7b-f86d-47f2-993a-735d9600ef3b) Aug 03 13:18:34.209724 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:18:34.209724 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:18:34.211361 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:18:34.211361 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:34.211361 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 03 13:18:34.211361 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 03 13:18:34.211361 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 13:18:34.211361 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 13:18:34.211361 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 03 13:18:34.211361 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 03 13:18:34.211361 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 13:18:34.211361 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 13:18:34.211361 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 03 13:18:34.211361 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 03 13:18:34.211361 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 03 13:18:34.211361 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 03 13:18:34.211361 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 03 13:18:34.211361 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 03 13:18:34.211361 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 13:18:34.211361 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 13:18:34.211361 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 13:18:34.213082 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 13:18:34.213082 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 13:18:34.213082 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 13:18:34.213082 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 13:18:34.213082 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 13:18:34.213082 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 68774c4a-12d8-4d48-86d4-096aa31f6a50 could not be found. Aug 03 13:18:34.213082 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:18:34.213082 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:18:34.213082 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:18:34.213082 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:34.213082 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:18:34.213082 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:18:34.213082 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:18:34.213082 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:18:34.213082 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 13:18:34.213082 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 13:18:34.213082 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:18:34.213082 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:18:34.213082 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 03 13:18:34.213082 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:18:34.214661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 68774c4a-12d8-4d48-86d4-096aa31f6a50 could not be found. Aug 03 13:18:34.214661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:18:34.214661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:18:34.214661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:18:34.214661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:34.214661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:18:34.214661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:18:34.214661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:18:34.214661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:18:34.214661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 68774c4a-12d8-4d48-86d4-096aa31f6a50 could not be found. Aug 03 13:18:34.214661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:18:34.214661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-4f2198ec-098d-4f21-a203-3ee06a5a853f tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] Returning 404 to user: Snapshot 68774c4a-12d8-4d48-86d4-096aa31f6a50 could not be found. {{(pid=119410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:18:34.214661 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-4f2198ec-098d-4f21-a203-3ee06a5a853f tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/68774c4a-12d8-4d48-86d4-096aa31f6a50" status: 404 len: 111 microversion: 2.1 time: 0.033243 Aug 03 13:18:34.215820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 644/1291] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Aug 3 13:18:34 2022] GET /compute/v2.1/os-snapshots/68774c4a-12d8-4d48-86d4-096aa31f6a50 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:18:34.221844 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-4959eff8-5307-450d-9e83-77d0c2396caa tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] Calling method '.version_select at 0x7fe6d80b0160>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:34.456955 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-4959eff8-5307-450d-9e83-77d0c2396caa tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/47d79f47-d762-4cb9-9740-9f4ab9a62964" status: 202 len: 0 microversion: 2.1 time: 0.242353 Aug 03 13:18:34.460525 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 648/1292] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Aug 3 13:18:34 2022] DELETE /compute/v2.1/os-volumes/47d79f47-d762-4cb9-9740-9f4ab9a62964 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 13:18:34.465778 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-9a603252-a988-4473-8d56-4163abd7d3e8 tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] Calling method '.version_select at 0x7fe6d8ae30d0>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:34.512688 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-9a603252-a988-4473-8d56-4163abd7d3e8 tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/47d79f47-d762-4cb9-9740-9f4ab9a62964" status: 200 len: 344 microversion: 2.1 time: 0.050776 Aug 03 13:18:34.513314 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 645/1293] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Aug 3 13:18:34 2022] GET /compute/v2.1/os-volumes/47d79f47-d762-4cb9-9740-9f4ab9a62964 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:18:35.528204 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-c8708557-c3ac-4a79-a3db-ca571f4a65fb tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] Calling method '.version_select at 0x7fe6d825fe50>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:35.559714 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-c8708557-c3ac-4a79-a3db-ca571f4a65fb tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] HTTP exception thrown: Volume 47d79f47-d762-4cb9-9740-9f4ab9a62964 could not be found. Aug 03 13:18:35.561639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-c8708557-c3ac-4a79-a3db-ca571f4a65fb tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] Request method failure captured: Aug 03 13:18:35.561639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: GET /compute/v2.1/os-volumes/47d79f47-d762-4cb9-9740-9f4ab9a62964 HTTP/1.1 Aug 03 13:18:35.561639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 13:18:35.561639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 13:18:35.561639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 13:18:35.561639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 0 Aug 03 13:18:35.561639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 13:18:35.561639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 13:18:35.561639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 13:18:35.561639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 13:18:35.561639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nWi2yllTy1etRSNC_2axktjwhb_zhTph3S4oGqAJqvok3OPNMnkQs2nolxlxMyvpKi0Hs6EgO8R2xpkhBRHqIJ-ua_6nL72WMfp_9ic4ZupSgOAXyzid3qCpylGkqadFuipt8hOdvg70Lzv3a8voZvCOrYLJdrKjwN4ZUhiEMK6D9k Aug 03 13:18:35.561639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 13:18:35.561639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 13:18:35.561639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 13:18:35.561639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 13:18:35.561639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 13:18:35.561639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 13:18:35.561639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: f6cc3c3890134449a4a63bd46f2430a5 Aug 03 13:18:35.561639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-812426814 Aug 03 13:18:35.561639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 13:18:35.561639 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 13:18:35.570507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f6cc3c3890134449a4a63bd46f2430a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f6cc3c3890134449a4a63bd46f2430a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f6cc3c3890134449a4a63bd46f2430a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f6cc3c3890134449a4a63bd46f2430a5", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:18:35.570507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-VolumesSnapshotsTestJSON-812426814 Aug 03 13:18:35.570507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: f6cc3c3890134449a4a63bd46f2430a5 Aug 03 13:18:35.570507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-812426814 Aug 03 13:18:35.570507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-VolumesSnapshotsTestJSON-812426814-project Aug 03 13:18:35.570507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 13:18:35.570507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 13:18:35.570507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: 3e3980ddaf444b4199f455ab270c3afd Aug 03 13:18:35.570507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-VolumesSnapshotsTestJSON-812426814-project Aug 03 13:18:35.570507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: Aug 03 13:18:35.570507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Volume 47d79f47-d762-4cb9-9740-9f4ab9a62964 could not be found. Aug 03 13:18:35.570507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'id': '47d79f47-d762-4cb9-9740-9f4ab9a62964'} Aug 03 13:18:35.570507 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:18:35.572764 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:35.572764 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 13:18:35.572764 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 13:18:35.572764 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 13:18:35.572764 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 13:18:35.572764 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 13:18:35.572764 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 13:18:35.572764 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 13:18:35.572764 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 13:18:35.572764 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 13:18:35.572764 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 13:18:35.572764 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 13:18:35.572764 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 13:18:35.572764 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 13:18:35.572764 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 13:18:35.572764 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 47d79f47-d762-4cb9-9740-9f4ab9a62964 could not be found. (HTTP 404) (Request-ID: req-408d47dc-99d6-4e6f-b836-c8d065ea28ca) Aug 03 13:18:35.572764 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:18:35.572764 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:18:35.572764 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:18:35.574133 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:35.574133 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 13:18:35.574133 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 13:18:35.574133 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 13:18:35.574133 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 13:18:35.574133 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 13:18:35.574133 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 13:18:35.574133 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 13:18:35.574133 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 13:18:35.574133 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 13:18:35.574133 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 13:18:35.574133 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 13:18:35.574133 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 13:18:35.574133 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 13:18:35.574133 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 13:18:35.574133 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 13:18:35.574133 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 13:18:35.574133 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 13:18:35.574133 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 13:18:35.575447 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 13:18:35.575447 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 13:18:35.575447 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 13:18:35.575447 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 13:18:35.575447 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 47d79f47-d762-4cb9-9740-9f4ab9a62964 could not be found. Aug 03 13:18:35.575447 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:18:35.575447 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:18:35.575447 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:18:35.575447 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:35.575447 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:18:35.575447 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:18:35.575447 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:18:35.575447 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:18:35.575447 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 13:18:35.575447 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 13:18:35.575447 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:18:35.575447 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:18:35.575447 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 13:18:35.575447 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:18:35.576735 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 47d79f47-d762-4cb9-9740-9f4ab9a62964 could not be found. Aug 03 13:18:35.576735 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:18:35.576735 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:18:35.576735 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:18:35.576735 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:35.576735 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:18:35.576735 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:18:35.576735 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:18:35.576735 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:18:35.576735 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 47d79f47-d762-4cb9-9740-9f4ab9a62964 could not be found. Aug 03 13:18:35.576735 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:18:35.576735 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-c8708557-c3ac-4a79-a3db-ca571f4a65fb tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] Returning 404 to user: Volume 47d79f47-d762-4cb9-9740-9f4ab9a62964 could not be found. {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:18:35.576735 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-c8708557-c3ac-4a79-a3db-ca571f4a65fb tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/47d79f47-d762-4cb9-9740-9f4ab9a62964" status: 404 len: 109 microversion: 2.1 time: 0.039456 Aug 03 13:18:35.576735 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 649/1294] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Aug 3 13:18:35 2022] GET /compute/v2.1/os-volumes/47d79f47-d762-4cb9-9740-9f4ab9a62964 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:18:35.579682 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d65dfd6d-869b-403a-90ea-4ed82893eea9 tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] Calling method '.version_select at 0x7fe6d80cc4c0>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:35.609736 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.wsgi [None req-d65dfd6d-869b-403a-90ea-4ed82893eea9 tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] HTTP exception thrown: Volume 47d79f47-d762-4cb9-9740-9f4ab9a62964 could not be found. Aug 03 13:18:35.612355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d65dfd6d-869b-403a-90ea-4ed82893eea9 tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] Request method failure captured: Aug 03 13:18:35.612355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: request: DELETE /compute/v2.1/os-volumes/47d79f47-d762-4cb9-9740-9f4ab9a62964 HTTP/1.1 Aug 03 13:18:35.612355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept: application/json Aug 03 13:18:35.612355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept-Encoding: identity Aug 03 13:18:35.612355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Connection: close Aug 03 13:18:35.612355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Length: 0 Aug 03 13:18:35.612355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Type: application/json Aug 03 13:18:35.612355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Host: 10.222.0.64 Aug 03 13:18:35.612355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Openstack-System-Scope: None Aug 03 13:18:35.612355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: User-Agent: python-urllib3/1.26.10 Aug 03 13:18:35.612355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Auth-Token: gAAAAABi6nWi2yllTy1etRSNC_2axktjwhb_zhTph3S4oGqAJqvok3OPNMnkQs2nolxlxMyvpKi0Hs6EgO8R2xpkhBRHqIJ-ua_6nL72WMfp_9ic4ZupSgOAXyzid3qCpylGkqadFuipt8hOdvg70Lzv3a8voZvCOrYLJdrKjwN4ZUhiEMK6D9k Aug 03 13:18:35.612355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Id: None Aug 03 13:18:35.612355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Name: None Aug 03 13:18:35.612355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Identity-Status: Confirmed Aug 03 13:18:35.612355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Is-Admin-Project: True Aug 03 13:18:35.612355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Id: default Aug 03 13:18:35.612355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Name: Default Aug 03 13:18:35.612355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Id: f6cc3c3890134449a4a63bd46f2430a5 Aug 03 13:18:35.612355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-812426814 Aug 03 13:18:35.612355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Role: member,reader Aug 03 13:18:35.612355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Roles: member,reader Aug 03 13:18:35.614054 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f6cc3c3890134449a4a63bd46f2430a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f6cc3c3890134449a4a63bd46f2430a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f6cc3c3890134449a4a63bd46f2430a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f6cc3c3890134449a4a63bd46f2430a5", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:18:35.614054 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant: tempest-VolumesSnapshotsTestJSON-812426814 Aug 03 13:18:35.614054 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Id: f6cc3c3890134449a4a63bd46f2430a5 Aug 03 13:18:35.614054 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-812426814 Aug 03 13:18:35.614054 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User: tempest-VolumesSnapshotsTestJSON-812426814-project Aug 03 13:18:35.614054 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Id: default Aug 03 13:18:35.614054 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Name: Default Aug 03 13:18:35.614054 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Id: 3e3980ddaf444b4199f455ab270c3afd Aug 03 13:18:35.614054 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Name: tempest-VolumesSnapshotsTestJSON-812426814-project Aug 03 13:18:35.614054 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: method: Aug 03 13:18:35.614054 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: exception: Volume 47d79f47-d762-4cb9-9740-9f4ab9a62964 could not be found. Aug 03 13:18:35.614054 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: action_args: {'id': '47d79f47-d762-4cb9-9740-9f4ab9a62964'} Aug 03 13:18:35.614054 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:18:35.615063 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:35.615063 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 13:18:35.615063 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 13:18:35.615063 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 13:18:35.615063 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 13:18:35.615063 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 13:18:35.615063 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 13:18:35.615063 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 13:18:35.615063 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 13:18:35.615063 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 13:18:35.615063 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 13:18:35.615063 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 13:18:35.615063 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 13:18:35.615063 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 13:18:35.615063 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 13:18:35.615063 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 47d79f47-d762-4cb9-9740-9f4ab9a62964 could not be found. (HTTP 404) (Request-ID: req-508a891a-d4c1-46b3-a4c7-bfad07aef3ea) Aug 03 13:18:35.615063 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:18:35.615063 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:18:35.615063 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:18:35.616390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:35.616390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 03 13:18:35.616390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 03 13:18:35.616390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 13:18:35.616390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 13:18:35.616390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 13:18:35.616390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 13:18:35.616390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 13:18:35.616390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 13:18:35.616390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 13:18:35.616390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 13:18:35.616390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 13:18:35.616390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 13:18:35.616390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 13:18:35.616390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 13:18:35.616390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 13:18:35.616390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 13:18:35.616390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 13:18:35.616390 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 13:18:35.617895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 13:18:35.617895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 13:18:35.617895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 13:18:35.617895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 13:18:35.617895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 47d79f47-d762-4cb9-9740-9f4ab9a62964 could not be found. Aug 03 13:18:35.617895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:18:35.617895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:18:35.617895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:18:35.617895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:35.617895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:18:35.617895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:18:35.617895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:18:35.617895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:18:35.617895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 13:18:35.617895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 13:18:35.617895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:18:35.617895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:18:35.617895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 03 13:18:35.617895 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:18:35.619417 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 47d79f47-d762-4cb9-9740-9f4ab9a62964 could not be found. Aug 03 13:18:35.619417 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:18:35.619417 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:18:35.619417 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:18:35.619417 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:35.619417 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:18:35.619417 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:18:35.619417 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:18:35.619417 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:18:35.619417 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 47d79f47-d762-4cb9-9740-9f4ab9a62964 could not be found. Aug 03 13:18:35.619417 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:18:35.619417 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d65dfd6d-869b-403a-90ea-4ed82893eea9 tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] Returning 404 to user: Volume 47d79f47-d762-4cb9-9740-9f4ab9a62964 could not be found. {{(pid=119410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:18:35.619417 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d65dfd6d-869b-403a-90ea-4ed82893eea9 tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/47d79f47-d762-4cb9-9740-9f4ab9a62964" status: 404 len: 109 microversion: 2.1 time: 0.038618 Aug 03 13:18:35.619417 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 646/1295] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Aug 3 13:18:35 2022] DELETE /compute/v2.1/os-volumes/47d79f47-d762-4cb9-9740-9f4ab9a62964 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:18:35.622499 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-e43cf952-b5df-49a2-820d-001b00ad07ed tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] Calling method '.version_select at 0x7fe6d80b01f0>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:18:35.650663 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.wsgi [None req-e43cf952-b5df-49a2-820d-001b00ad07ed tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] HTTP exception thrown: Volume 47d79f47-d762-4cb9-9740-9f4ab9a62964 could not be found. Aug 03 13:18:35.651838 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-e43cf952-b5df-49a2-820d-001b00ad07ed tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] Request method failure captured: Aug 03 13:18:35.651838 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: request: GET /compute/v2.1/os-volumes/47d79f47-d762-4cb9-9740-9f4ab9a62964 HTTP/1.1 Aug 03 13:18:35.651838 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept: application/json Aug 03 13:18:35.651838 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Accept-Encoding: identity Aug 03 13:18:35.651838 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Connection: close Aug 03 13:18:35.651838 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Length: 0 Aug 03 13:18:35.651838 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Content-Type: application/json Aug 03 13:18:35.651838 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Host: 10.222.0.64 Aug 03 13:18:35.651838 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Openstack-System-Scope: None Aug 03 13:18:35.651838 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: User-Agent: python-urllib3/1.26.10 Aug 03 13:18:35.651838 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Auth-Token: gAAAAABi6nWi2yllTy1etRSNC_2axktjwhb_zhTph3S4oGqAJqvok3OPNMnkQs2nolxlxMyvpKi0Hs6EgO8R2xpkhBRHqIJ-ua_6nL72WMfp_9ic4ZupSgOAXyzid3qCpylGkqadFuipt8hOdvg70Lzv3a8voZvCOrYLJdrKjwN4ZUhiEMK6D9k Aug 03 13:18:35.651838 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Id: None Aug 03 13:18:35.651838 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Domain-Name: None Aug 03 13:18:35.651838 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Identity-Status: Confirmed Aug 03 13:18:35.651838 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Is-Admin-Project: True Aug 03 13:18:35.651838 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Id: default Aug 03 13:18:35.651838 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Domain-Name: Default Aug 03 13:18:35.651838 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Id: f6cc3c3890134449a4a63bd46f2430a5 Aug 03 13:18:35.651838 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-812426814 Aug 03 13:18:35.651838 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Role: member,reader Aug 03 13:18:35.651838 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Roles: member,reader Aug 03 13:18:35.653531 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f6cc3c3890134449a4a63bd46f2430a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f6cc3c3890134449a4a63bd46f2430a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f6cc3c3890134449a4a63bd46f2430a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f6cc3c3890134449a4a63bd46f2430a5", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:18:35.653531 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant: tempest-VolumesSnapshotsTestJSON-812426814 Aug 03 13:18:35.653531 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Id: f6cc3c3890134449a4a63bd46f2430a5 Aug 03 13:18:35.653531 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-812426814 Aug 03 13:18:35.653531 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User: tempest-VolumesSnapshotsTestJSON-812426814-project Aug 03 13:18:35.653531 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Id: default Aug 03 13:18:35.653531 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Domain-Name: Default Aug 03 13:18:35.653531 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Id: 3e3980ddaf444b4199f455ab270c3afd Aug 03 13:18:35.653531 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: X-User-Name: tempest-VolumesSnapshotsTestJSON-812426814-project Aug 03 13:18:35.653531 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: method: Aug 03 13:18:35.653531 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: exception: Volume 47d79f47-d762-4cb9-9740-9f4ab9a62964 could not be found. Aug 03 13:18:35.653531 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: action_args: {'id': '47d79f47-d762-4cb9-9740-9f4ab9a62964'} Aug 03 13:18:35.653531 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:18:35.654552 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:35.654552 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 13:18:35.654552 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 13:18:35.654552 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 13:18:35.654552 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 13:18:35.654552 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 13:18:35.654552 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 13:18:35.654552 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 13:18:35.654552 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 13:18:35.654552 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 13:18:35.654552 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 13:18:35.654552 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 13:18:35.654552 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 13:18:35.654552 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 13:18:35.654552 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 13:18:35.654552 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 47d79f47-d762-4cb9-9740-9f4ab9a62964 could not be found. (HTTP 404) (Request-ID: req-46eaff4d-7a0c-4063-b7e4-d3717e19aaf7) Aug 03 13:18:35.654552 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:18:35.654552 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:18:35.654552 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:18:35.656044 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:35.656044 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 13:18:35.656044 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 13:18:35.656044 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 13:18:35.656044 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 13:18:35.656044 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 13:18:35.656044 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 13:18:35.656044 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 13:18:35.656044 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 13:18:35.656044 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 13:18:35.656044 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 13:18:35.656044 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 13:18:35.656044 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 13:18:35.656044 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 13:18:35.656044 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 13:18:35.656044 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 13:18:35.656044 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 13:18:35.656044 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 13:18:35.656044 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 13:18:35.659368 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 13:18:35.659368 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 13:18:35.659368 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 13:18:35.659368 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 13:18:35.659368 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 47d79f47-d762-4cb9-9740-9f4ab9a62964 could not be found. Aug 03 13:18:35.659368 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:18:35.659368 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:18:35.659368 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:18:35.659368 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:35.659368 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:18:35.659368 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:18:35.659368 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:18:35.659368 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:18:35.659368 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 13:18:35.659368 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 13:18:35.659368 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:18:35.659368 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:18:35.659368 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 13:18:35.659368 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:18:35.661592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 47d79f47-d762-4cb9-9740-9f4ab9a62964 could not be found. Aug 03 13:18:35.661592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:18:35.661592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:18:35.661592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:18:35.661592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:18:35.661592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:18:35.661592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:18:35.661592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:18:35.661592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:18:35.661592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 47d79f47-d762-4cb9-9740-9f4ab9a62964 could not be found. Aug 03 13:18:35.661592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: ERROR nova.api.openstack.wsgi Aug 03 13:18:35.661592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-e43cf952-b5df-49a2-820d-001b00ad07ed tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] Returning 404 to user: Volume 47d79f47-d762-4cb9-9740-9f4ab9a62964 could not be found. {{(pid=119409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:18:35.661592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-e43cf952-b5df-49a2-820d-001b00ad07ed tempest-VolumesSnapshotsTestJSON-812426814 tempest-VolumesSnapshotsTestJSON-812426814-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/47d79f47-d762-4cb9-9740-9f4ab9a62964" status: 404 len: 109 microversion: 2.1 time: 0.034623 Aug 03 13:18:35.661592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 650/1296] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Aug 3 13:18:35 2022] GET /compute/v2.1/os-volumes/47d79f47-d762-4cb9-9740-9f4ab9a62964 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:19:08.052948 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=3 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:19:08.053698 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=3 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:19:08.058241 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-3e75ebc5-f21b-4520-b130-49d6b8fdb6bb tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1058065766", "imageRef": "c0aabcc0-d4af-4f0e-b8a5-d140344fce1f", "flavorRef": "452", "networks": [{"uuid": "5f37e0cc-1a98-46de-b43f-53aa1adab767"}]}} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:19:08.109869 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.network.neutron [None req-3e75ebc5-f21b-4520-b130-49d6b8fdb6bb tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] validate_networks() for [('5f37e0cc-1a98-46de-b43f-53aa1adab767', None, None, None, None, None)] {{(pid=119410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 13:19:08.448494 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-3e75ebc5-f21b-4520-b130-49d6b8fdb6bb tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Flavor limits 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 13:19:08.448919 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-3e75ebc5-f21b-4520-b130-49d6b8fdb6bb tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Image limits 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 13:19:08.449397 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-3e75ebc5-f21b-4520-b130-49d6b8fdb6bb tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Flavor pref 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 13:19:08.449804 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-3e75ebc5-f21b-4520-b130-49d6b8fdb6bb tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Image pref 0:0:0 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 13:19:08.450216 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.virt.hardware [None req-3e75ebc5-f21b-4520-b130-49d6b8fdb6bb tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 13:19:08.459078 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3e75ebc5-f21b-4520-b130-49d6b8fdb6bb tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:19:08.459530 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3e75ebc5-f21b-4520-b130-49d6b8fdb6bb tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:19:08.460331 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3e75ebc5-f21b-4520-b130-49d6b8fdb6bb tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:19:08.460775 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3e75ebc5-f21b-4520-b130-49d6b8fdb6bb tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:19:08.485394 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.quota [None req-3e75ebc5-f21b-4520-b130-49d6b8fdb6bb tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Getting quotas for project dcdb85a0e97a498ba3c84801d5a87c61. Resources: {'instances', 'ram', 'cores'} {{(pid=119410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 13:19:08.489877 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.quota [None req-3e75ebc5-f21b-4520-b130-49d6b8fdb6bb tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Getting quotas for user 66011efd111b4472992ad4c66963def1 and project dcdb85a0e97a498ba3c84801d5a87c61. Resources: {'instances', 'ram', 'cores'} {{(pid=119410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 13:19:08.500515 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-3e75ebc5-f21b-4520-b130-49d6b8fdb6bb tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Going to run 1 instances... {{(pid=119410) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 13:19:08.502723 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-3e75ebc5-f21b-4520-b130-49d6b8fdb6bb tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 5038bf7d-256b-4252-a7c0-a7cd89bab16a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0aabcc0-d4af-4f0e-b8a5-d140344fce1f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 13:19:08.667211 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3e75ebc5-f21b-4520-b130-49d6b8fdb6bb tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [d8e82c45-73dc-46b1-97f8-90a9e9038f47] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 13:19:09.673799 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO oslo.messaging._drivers.impl_rabbit [None req-3e75ebc5-f21b-4520-b130-49d6b8fdb6bb tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [d8e82c45-73dc-46b1-97f8-90a9e9038f47] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 43352. Aug 03 13:19:09.678157 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-3e75ebc5-f21b-4520-b130-49d6b8fdb6bb tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.626501 Aug 03 13:19:09.678864 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 647/1297] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 3 13:19:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 13:19:09.690244 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-4cbf187d-5fdd-400f-b72a-67f2e9b58b27 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:19:09.691439 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-4cbf187d-5fdd-400f-b72a-67f2e9b58b27 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 5038bf7d-256b-4252-a7c0-a7cd89bab16a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:19:09.744009 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-4cbf187d-5fdd-400f-b72a-67f2e9b58b27 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66011efd111b4472992ad4c66963def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdb85a0e97a498ba3c84801d5a87c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:19:09.751219 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-4cbf187d-5fdd-400f-b72a-67f2e9b58b27 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a" status: 200 len: 1219 microversion: 2.1 time: 0.065684 Aug 03 13:19:09.751764 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 651/1298] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:19:09 2022] GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:19:10.772664 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e533edbb-8c55-48e0-b0a4-eccb37878a92 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:19:10.773263 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-e533edbb-8c55-48e0-b0a4-eccb37878a92 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 5038bf7d-256b-4252-a7c0-a7cd89bab16a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:19:10.781600 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e533edbb-8c55-48e0-b0a4-eccb37878a92 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:19:10.782056 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e533edbb-8c55-48e0-b0a4-eccb37878a92 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:19:10.782849 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e533edbb-8c55-48e0-b0a4-eccb37878a92 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:19:10.783291 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e533edbb-8c55-48e0-b0a4-eccb37878a92 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:19:10.845646 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-e533edbb-8c55-48e0-b0a4-eccb37878a92 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66011efd111b4472992ad4c66963def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdb85a0e97a498ba3c84801d5a87c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:19:10.854249 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-e533edbb-8c55-48e0-b0a4-eccb37878a92 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a" status: 200 len: 1223 microversion: 2.1 time: 0.085899 Aug 03 13:19:10.854861 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 648/1299] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:19:10 2022] GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:19:11.875657 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d823f5f0-6987-49b5-8e10-33c0ed3998ad tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:19:11.876355 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-d823f5f0-6987-49b5-8e10-33c0ed3998ad tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 5038bf7d-256b-4252-a7c0-a7cd89bab16a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:19:11.884226 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d823f5f0-6987-49b5-8e10-33c0ed3998ad tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:19:11.884753 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d823f5f0-6987-49b5-8e10-33c0ed3998ad tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:19:11.885628 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d823f5f0-6987-49b5-8e10-33c0ed3998ad tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:19:11.886177 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d823f5f0-6987-49b5-8e10-33c0ed3998ad tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:19:11.951956 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-d823f5f0-6987-49b5-8e10-33c0ed3998ad tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66011efd111b4472992ad4c66963def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdb85a0e97a498ba3c84801d5a87c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:19:11.960188 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-d823f5f0-6987-49b5-8e10-33c0ed3998ad tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a" status: 200 len: 1277 microversion: 2.1 time: 0.088562 Aug 03 13:19:11.960787 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 652/1300] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:19:11 2022] GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a => generated 1277 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:19:12.981034 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-be25d37a-3a1a-4767-9705-418fe6c02843 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:19:12.981652 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-be25d37a-3a1a-4767-9705-418fe6c02843 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 5038bf7d-256b-4252-a7c0-a7cd89bab16a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:19:12.988266 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-be25d37a-3a1a-4767-9705-418fe6c02843 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:19:12.988730 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-be25d37a-3a1a-4767-9705-418fe6c02843 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:19:12.990126 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-be25d37a-3a1a-4767-9705-418fe6c02843 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:19:12.990599 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-be25d37a-3a1a-4767-9705-418fe6c02843 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:19:13.062863 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-ec144778-49f7-48b3-94c1-7f1da82814ef req-fe33fbfe-486c-4f5c-a951-1c8bfa4f1b10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5038bf7d-256b-4252-a7c0-a7cd89bab16a", "tag": "b87781f7-b0c2-491a-b715-fd024f631696"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:19:13.075740 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-ec144778-49f7-48b3-94c1-7f1da82814ef req-fe33fbfe-486c-4f5c-a951-1c8bfa4f1b10 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:19:13.077145 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-ec144778-49f7-48b3-94c1-7f1da82814ef req-fe33fbfe-486c-4f5c-a951-1c8bfa4f1b10 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:19:13.089101 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-ec144778-49f7-48b3-94c1-7f1da82814ef req-fe33fbfe-486c-4f5c-a951-1c8bfa4f1b10 service nova] Creating event network-changed:b87781f7-b0c2-491a-b715-fd024f631696 for instance 5038bf7d-256b-4252-a7c0-a7cd89bab16a on hv-cinder-85083 Aug 03 13:19:13.094645 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-ec144778-49f7-48b3-94c1-7f1da82814ef req-fe33fbfe-486c-4f5c-a951-1c8bfa4f1b10 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035824 Aug 03 13:19:13.095279 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 653/1301] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:19:13.128905 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-be25d37a-3a1a-4767-9705-418fe6c02843 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66011efd111b4472992ad4c66963def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdb85a0e97a498ba3c84801d5a87c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:19:13.136664 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-be25d37a-3a1a-4767-9705-418fe6c02843 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a" status: 200 len: 1319 microversion: 2.1 time: 0.159523 Aug 03 13:19:13.137245 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 649/1302] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:19:12 2022] GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:19:14.158354 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-fd149f92-0bd0-48b2-a78d-4dc2b906a396 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:19:14.159147 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-fd149f92-0bd0-48b2-a78d-4dc2b906a396 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 5038bf7d-256b-4252-a7c0-a7cd89bab16a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:19:14.165668 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fd149f92-0bd0-48b2-a78d-4dc2b906a396 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:19:14.166115 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fd149f92-0bd0-48b2-a78d-4dc2b906a396 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:19:14.166915 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fd149f92-0bd0-48b2-a78d-4dc2b906a396 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:19:14.167352 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-fd149f92-0bd0-48b2-a78d-4dc2b906a396 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:19:14.295711 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-fd149f92-0bd0-48b2-a78d-4dc2b906a396 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66011efd111b4472992ad4c66963def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdb85a0e97a498ba3c84801d5a87c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:19:14.303541 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-fd149f92-0bd0-48b2-a78d-4dc2b906a396 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a" status: 200 len: 1319 microversion: 2.1 time: 0.149791 Aug 03 13:19:14.304097 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 654/1303] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:19:14 2022] GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:19:15.323757 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-2d6ab6de-b105-42b6-b162-3e771aafe46b tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:19:15.329253 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-2d6ab6de-b105-42b6-b162-3e771aafe46b tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 5038bf7d-256b-4252-a7c0-a7cd89bab16a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:19:15.330881 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2d6ab6de-b105-42b6-b162-3e771aafe46b tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:19:15.331331 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2d6ab6de-b105-42b6-b162-3e771aafe46b tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:19:15.332090 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2d6ab6de-b105-42b6-b162-3e771aafe46b tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:19:15.332523 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-2d6ab6de-b105-42b6-b162-3e771aafe46b tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:19:15.461380 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-2d6ab6de-b105-42b6-b162-3e771aafe46b tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66011efd111b4472992ad4c66963def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdb85a0e97a498ba3c84801d5a87c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:19:15.468735 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-2d6ab6de-b105-42b6-b162-3e771aafe46b tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a" status: 200 len: 1319 microversion: 2.1 time: 0.148849 Aug 03 13:19:15.469296 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 650/1304] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:19:15 2022] GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:19:16.489417 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-145f0092-9653-417c-b60c-64c5ce02dc4a tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:19:16.490059 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-145f0092-9653-417c-b60c-64c5ce02dc4a tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 5038bf7d-256b-4252-a7c0-a7cd89bab16a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:19:16.496517 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-145f0092-9653-417c-b60c-64c5ce02dc4a tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:19:16.496969 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-145f0092-9653-417c-b60c-64c5ce02dc4a tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:19:16.497737 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-145f0092-9653-417c-b60c-64c5ce02dc4a tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:19:16.498170 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-145f0092-9653-417c-b60c-64c5ce02dc4a tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:19:16.623392 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-145f0092-9653-417c-b60c-64c5ce02dc4a tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66011efd111b4472992ad4c66963def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdb85a0e97a498ba3c84801d5a87c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:19:16.630966 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-145f0092-9653-417c-b60c-64c5ce02dc4a tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a" status: 200 len: 1319 microversion: 2.1 time: 0.145411 Aug 03 13:19:16.631549 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 655/1305] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:19:16 2022] GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:19:17.652269 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d3f99554-0e0f-404d-b24b-6ea91cb74ec8 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:19:17.652817 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d3f99554-0e0f-404d-b24b-6ea91cb74ec8 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 5038bf7d-256b-4252-a7c0-a7cd89bab16a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:19:17.659373 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d3f99554-0e0f-404d-b24b-6ea91cb74ec8 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:19:17.660083 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d3f99554-0e0f-404d-b24b-6ea91cb74ec8 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:19:17.661336 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d3f99554-0e0f-404d-b24b-6ea91cb74ec8 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:19:17.661774 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d3f99554-0e0f-404d-b24b-6ea91cb74ec8 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:19:17.790222 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d3f99554-0e0f-404d-b24b-6ea91cb74ec8 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66011efd111b4472992ad4c66963def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdb85a0e97a498ba3c84801d5a87c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:19:17.797684 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d3f99554-0e0f-404d-b24b-6ea91cb74ec8 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a" status: 200 len: 1319 microversion: 2.1 time: 0.149316 Aug 03 13:19:17.798267 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 651/1306] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:19:17 2022] GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 13:19:18.818816 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-39d787f2-da16-4db7-8342-639997552f4b tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:19:18.819395 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-39d787f2-da16-4db7-8342-639997552f4b tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 5038bf7d-256b-4252-a7c0-a7cd89bab16a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:19:18.826392 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-39d787f2-da16-4db7-8342-639997552f4b tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:19:18.826883 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-39d787f2-da16-4db7-8342-639997552f4b tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:19:18.827647 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-39d787f2-da16-4db7-8342-639997552f4b tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:19:18.828082 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-39d787f2-da16-4db7-8342-639997552f4b tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:19:18.957589 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-39d787f2-da16-4db7-8342-639997552f4b tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66011efd111b4472992ad4c66963def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdb85a0e97a498ba3c84801d5a87c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:19:18.964875 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-39d787f2-da16-4db7-8342-639997552f4b tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a" status: 200 len: 1319 microversion: 2.1 time: 0.150127 Aug 03 13:19:18.965439 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 656/1307] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:19:18 2022] GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:19:19.985858 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-621082f9-08cd-4f13-a024-79d58e2e8a1f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:19:19.992784 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-621082f9-08cd-4f13-a024-79d58e2e8a1f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 5038bf7d-256b-4252-a7c0-a7cd89bab16a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:19:19.992784 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=2 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:19:19.992784 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=6 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:19:19.993126 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-8cf1fe63-fa4a-4b26-a783-e1d723cc3f8b req-fc23a4cf-8d21-41f9-a967-2e1cdd95fb67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5038bf7d-256b-4252-a7c0-a7cd89bab16a", "name": "network-vif-plugged", "status": "completed", "tag": "b87781f7-b0c2-491a-b715-fd024f631696"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:19:19.995355 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-621082f9-08cd-4f13-a024-79d58e2e8a1f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:19:19.996055 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-621082f9-08cd-4f13-a024-79d58e2e8a1f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:19:19.996817 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-621082f9-08cd-4f13-a024-79d58e2e8a1f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:19:19.997646 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-621082f9-08cd-4f13-a024-79d58e2e8a1f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:19:19.997905 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell0:SELECT=2 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:19:20.002340 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-8cf1fe63-fa4a-4b26-a783-e1d723cc3f8b req-fc23a4cf-8d21-41f9-a967-2e1cdd95fb67 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:19:20.002812 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-8cf1fe63-fa4a-4b26-a783-e1d723cc3f8b req-fc23a4cf-8d21-41f9-a967-2e1cdd95fb67 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:19:20.016177 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-8cf1fe63-fa4a-4b26-a783-e1d723cc3f8b req-fc23a4cf-8d21-41f9-a967-2e1cdd95fb67 service nova] Creating event network-vif-plugged:b87781f7-b0c2-491a-b715-fd024f631696 for instance 5038bf7d-256b-4252-a7c0-a7cd89bab16a on hv-cinder-85083 Aug 03 13:19:20.021845 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-8cf1fe63-fa4a-4b26-a783-e1d723cc3f8b req-fc23a4cf-8d21-41f9-a967-2e1cdd95fb67 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034726 Aug 03 13:19:20.022476 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 657/1308] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 13:19:20.133141 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-621082f9-08cd-4f13-a024-79d58e2e8a1f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66011efd111b4472992ad4c66963def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdb85a0e97a498ba3c84801d5a87c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:19:20.144628 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-621082f9-08cd-4f13-a024-79d58e2e8a1f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a" status: 200 len: 1319 microversion: 2.1 time: 0.159548 Aug 03 13:19:20.144628 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 652/1309] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:19:19 2022] GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:19:21.163712 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-4569c50f-d627-4a3e-b00c-6455520c3543 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:19:21.164409 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-4569c50f-d627-4a3e-b00c-6455520c3543 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 5038bf7d-256b-4252-a7c0-a7cd89bab16a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:19:21.171362 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4569c50f-d627-4a3e-b00c-6455520c3543 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:19:21.171802 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4569c50f-d627-4a3e-b00c-6455520c3543 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:19:21.172549 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4569c50f-d627-4a3e-b00c-6455520c3543 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:19:21.172979 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4569c50f-d627-4a3e-b00c-6455520c3543 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:19:21.303030 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-4569c50f-d627-4a3e-b00c-6455520c3543 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66011efd111b4472992ad4c66963def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdb85a0e97a498ba3c84801d5a87c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:19:21.310401 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-4569c50f-d627-4a3e-b00c-6455520c3543 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a" status: 200 len: 1319 microversion: 2.1 time: 0.151724 Aug 03 13:19:21.310998 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 658/1310] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:19:21 2022] GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:19:22.330744 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-3e74e4d7-89ff-45ec-874f-de73b6a6606e tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:19:22.331445 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-3e74e4d7-89ff-45ec-874f-de73b6a6606e tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 5038bf7d-256b-4252-a7c0-a7cd89bab16a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:19:22.338439 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3e74e4d7-89ff-45ec-874f-de73b6a6606e tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:19:22.338926 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3e74e4d7-89ff-45ec-874f-de73b6a6606e tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:19:22.339768 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3e74e4d7-89ff-45ec-874f-de73b6a6606e tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:19:22.340205 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-3e74e4d7-89ff-45ec-874f-de73b6a6606e tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:19:22.466186 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-3e74e4d7-89ff-45ec-874f-de73b6a6606e tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66011efd111b4472992ad4c66963def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdb85a0e97a498ba3c84801d5a87c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:19:22.474186 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-3e74e4d7-89ff-45ec-874f-de73b6a6606e tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a" status: 200 len: 1509 microversion: 2.1 time: 0.147247 Aug 03 13:19:22.474838 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 653/1311] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:19:22 2022] GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a => generated 1509 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:19:40.469933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 13:19:40.470570 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Wed Aug 3 13:19:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 13:19:44.184229 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-7ec06f16-e49f-43c6-8816-9dce523a6d48 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3447b69c-4169-4a7d-96cb-c9abe953d32f", "device": "/dev/sdb"}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:19:44.187138 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-7ec06f16-e49f-43c6-8816-9dce523a6d48 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 5038bf7d-256b-4252-a7c0-a7cd89bab16a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:19:44.189772 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=18 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:19:44.190465 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=34 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:19:44.195972 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7ec06f16-e49f-43c6-8816-9dce523a6d48 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:19:44.196399 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7ec06f16-e49f-43c6-8816-9dce523a6d48 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:19:44.197156 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7ec06f16-e49f-43c6-8816-9dce523a6d48 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:19:44.197594 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7ec06f16-e49f-43c6-8816-9dce523a6d48 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:19:44.916413 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-7ec06f16-e49f-43c6-8816-9dce523a6d48 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "POST /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.735991 Aug 03 13:19:44.916973 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 659/1312] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Aug 3 13:19:44 2022] POST /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a/os-volume_attachments => generated 194 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:20:12.559379 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d9caa68a-3834-45fd-a71b-ecf576c4d77f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:20:12.559881 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d9caa68a-3834-45fd-a71b-ecf576c4d77f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 5038bf7d-256b-4252-a7c0-a7cd89bab16a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:20:12.562058 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:20:12.562875 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=38 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:20:12.567445 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d9caa68a-3834-45fd-a71b-ecf576c4d77f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:12.570287 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d9caa68a-3834-45fd-a71b-ecf576c4d77f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:12.570287 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d9caa68a-3834-45fd-a71b-ecf576c4d77f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:12.570287 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d9caa68a-3834-45fd-a71b-ecf576c4d77f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:12.789071 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-d9caa68a-3834-45fd-a71b-ecf576c4d77f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lazy-loading 'services' on Instance uuid 5038bf7d-256b-4252-a7c0-a7cd89bab16a {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:20:12.967424 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d9caa68a-3834-45fd-a71b-ecf576c4d77f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "DELETE /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a/os-volume_attachments/3447b69c-4169-4a7d-96cb-c9abe953d32f" status: 202 len: 0 microversion: 2.1 time: 0.412241 Aug 03 13:20:12.968423 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 654/1313] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Aug 3 13:20:12 2022] DELETE /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a/os-volume_attachments/3447b69c-4169-4a7d-96cb-c9abe953d32f => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 13:20:14.084524 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=2 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:20:14.085296 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:20:14.089283 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-2000d4a9-95c4-4ed4-8425-c9b68560adc3 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:20:14.089875 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-2000d4a9-95c4-4ed4-8425-c9b68560adc3 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 5038bf7d-256b-4252-a7c0-a7cd89bab16a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:20:14.095974 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2000d4a9-95c4-4ed4-8425-c9b68560adc3 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:14.097933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2000d4a9-95c4-4ed4-8425-c9b68560adc3 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:14.097933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2000d4a9-95c4-4ed4-8425-c9b68560adc3 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:14.097933 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-2000d4a9-95c4-4ed4-8425-c9b68560adc3 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:14.123173 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-2000d4a9-95c4-4ed4-8425-c9b68560adc3 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 5038bf7d-256b-4252-a7c0-a7cd89bab16a] Going to try to terminate instance {{(pid=119409) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 13:20:14.415102 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-2000d4a9-95c4-4ed4-8425-c9b68560adc3 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "DELETE /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a" status: 204 len: 0 microversion: 2.1 time: 0.331106 Aug 03 13:20:14.415713 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 660/1314] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 3 13:20:14 2022] DELETE /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 13:20:14.425282 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-6935ef48-ba41-4e6e-a67c-63d8d1aa002c tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:20:14.425980 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-6935ef48-ba41-4e6e-a67c-63d8d1aa002c tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 5038bf7d-256b-4252-a7c0-a7cd89bab16a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:20:14.432988 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6935ef48-ba41-4e6e-a67c-63d8d1aa002c tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:14.433451 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6935ef48-ba41-4e6e-a67c-63d8d1aa002c tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:14.434222 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6935ef48-ba41-4e6e-a67c-63d8d1aa002c tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:14.434783 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-6935ef48-ba41-4e6e-a67c-63d8d1aa002c tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:14.798681 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-6935ef48-ba41-4e6e-a67c-63d8d1aa002c tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66011efd111b4472992ad4c66963def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdb85a0e97a498ba3c84801d5a87c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:20:14.806398 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-6935ef48-ba41-4e6e-a67c-63d8d1aa002c tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a" status: 200 len: 1515 microversion: 2.1 time: 0.385963 Aug 03 13:20:14.806987 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 655/1315] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:20:14 2022] GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a => generated 1515 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:20:15.827823 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-4c40e400-b5fe-494c-8144-1cc32283f371 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:20:15.828527 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-4c40e400-b5fe-494c-8144-1cc32283f371 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 5038bf7d-256b-4252-a7c0-a7cd89bab16a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:20:15.835014 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4c40e400-b5fe-494c-8144-1cc32283f371 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:15.835463 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4c40e400-b5fe-494c-8144-1cc32283f371 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:15.836875 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4c40e400-b5fe-494c-8144-1cc32283f371 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:15.837327 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4c40e400-b5fe-494c-8144-1cc32283f371 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:16.017366 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-4c40e400-b5fe-494c-8144-1cc32283f371 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66011efd111b4472992ad4c66963def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdb85a0e97a498ba3c84801d5a87c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:20:16.025392 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-4c40e400-b5fe-494c-8144-1cc32283f371 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a" status: 200 len: 1515 microversion: 2.1 time: 0.201804 Aug 03 13:20:16.025948 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 661/1316] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:20:15 2022] GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a => generated 1515 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:20:16.893210 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-ac60311a-4357-4ea0-9f89-5c17c2a1bdf7 req-0bcd40c1-638e-4f0c-b1a0-6cb788c9dddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5038bf7d-256b-4252-a7c0-a7cd89bab16a", "name": "network-vif-deleted", "tag": "b87781f7-b0c2-491a-b715-fd024f631696"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:20:16.903476 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-ac60311a-4357-4ea0-9f89-5c17c2a1bdf7 req-0bcd40c1-638e-4f0c-b1a0-6cb788c9dddb service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:16.903917 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-ac60311a-4357-4ea0-9f89-5c17c2a1bdf7 req-0bcd40c1-638e-4f0c-b1a0-6cb788c9dddb service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:16.915354 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-ac60311a-4357-4ea0-9f89-5c17c2a1bdf7 req-0bcd40c1-638e-4f0c-b1a0-6cb788c9dddb service nova] Creating event network-vif-deleted:b87781f7-b0c2-491a-b715-fd024f631696 for instance 5038bf7d-256b-4252-a7c0-a7cd89bab16a on hv-cinder-85083 Aug 03 13:20:16.920229 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-ac60311a-4357-4ea0-9f89-5c17c2a1bdf7 req-0bcd40c1-638e-4f0c-b1a0-6cb788c9dddb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030630 Aug 03 13:20:16.920807 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 656/1317] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:20:17.046658 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-57234baf-2c39-4310-b67e-a937c1f5bd81 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:20:17.047283 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-57234baf-2c39-4310-b67e-a937c1f5bd81 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 5038bf7d-256b-4252-a7c0-a7cd89bab16a] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:20:17.053828 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-57234baf-2c39-4310-b67e-a937c1f5bd81 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:17.054269 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-57234baf-2c39-4310-b67e-a937c1f5bd81 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:17.056093 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-57234baf-2c39-4310-b67e-a937c1f5bd81 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:17.056093 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-57234baf-2c39-4310-b67e-a937c1f5bd81 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:17.120013 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-57234baf-2c39-4310-b67e-a937c1f5bd81 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66011efd111b4472992ad4c66963def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdb85a0e97a498ba3c84801d5a87c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:20:17.127853 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-57234baf-2c39-4310-b67e-a937c1f5bd81 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a" status: 200 len: 1304 microversion: 2.1 time: 0.085119 Aug 03 13:20:17.128416 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 662/1318] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:20:17 2022] GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a => generated 1304 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:20:18.149349 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-284d2f8d-ab79-4116-9b6c-f961cb552c5f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:20:18.150033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-284d2f8d-ab79-4116-9b6c-f961cb552c5f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 5038bf7d-256b-4252-a7c0-a7cd89bab16a] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:20:18.156214 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-284d2f8d-ab79-4116-9b6c-f961cb552c5f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:18.156663 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-284d2f8d-ab79-4116-9b6c-f961cb552c5f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:18.157412 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-284d2f8d-ab79-4116-9b6c-f961cb552c5f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:18.157839 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-284d2f8d-ab79-4116-9b6c-f961cb552c5f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:18.171451 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.wsgi [None req-284d2f8d-ab79-4116-9b6c-f961cb552c5f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] HTTP exception thrown: Instance 5038bf7d-256b-4252-a7c0-a7cd89bab16a could not be found. Aug 03 13:20:18.173033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-284d2f8d-ab79-4116-9b6c-f961cb552c5f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Request method failure captured: Aug 03 13:20:18.173033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: request: GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a HTTP/1.1 Aug 03 13:20:18.173033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept: application/json Aug 03 13:20:18.173033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept-Encoding: identity Aug 03 13:20:18.173033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Connection: close Aug 03 13:20:18.173033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Length: 0 Aug 03 13:20:18.173033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Type: application/json Aug 03 13:20:18.173033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Host: 10.222.0.64 Aug 03 13:20:18.173033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Openstack-System-Scope: None Aug 03 13:20:18.173033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: User-Agent: python-urllib3/1.26.10 Aug 03 13:20:18.173033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Auth-Token: gAAAAABi6nXKpcEzXJCUiyvGIHAhzfvCFtBts-ZGlQXWfieSojSR4hzUgLNB5PfOBC2OidQ69kTIQf0SuvN3rzYJk1tbWpBbGv0MWngyDvbY8PNOxZ4Jv4DwmTzNZC6riBrndhkXwYYWNfFgYXrQaHzxDKhZDFjvHVht0NPOV8oGl7y5yEf3HNE Aug 03 13:20:18.173033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Id: None Aug 03 13:20:18.173033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Name: None Aug 03 13:20:18.173033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Identity-Status: Confirmed Aug 03 13:20:18.173033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Is-Admin-Project: True Aug 03 13:20:18.173033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Id: default Aug 03 13:20:18.173033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Name: Default Aug 03 13:20:18.173033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Id: dcdb85a0e97a498ba3c84801d5a87c61 Aug 03 13:20:18.173033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Name: tempest-VolumesSnapshotTestJSON-443356912 Aug 03 13:20:18.173033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Role: member,reader Aug 03 13:20:18.173033 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Roles: member,reader Aug 03 13:20:18.174877 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/dcdb85a0e97a498ba3c84801d5a87c61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/dcdb85a0e97a498ba3c84801d5a87c61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/dcdb85a0e97a498ba3c84801d5a87c61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_dcdb85a0e97a498ba3c84801d5a87c61", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:20:18.174877 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant: tempest-VolumesSnapshotTestJSON-443356912 Aug 03 13:20:18.174877 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Id: dcdb85a0e97a498ba3c84801d5a87c61 Aug 03 13:20:18.174877 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-443356912 Aug 03 13:20:18.174877 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User: tempest-VolumesSnapshotTestJSON-443356912-project Aug 03 13:20:18.174877 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Id: default Aug 03 13:20:18.174877 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Name: Default Aug 03 13:20:18.174877 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Id: 66011efd111b4472992ad4c66963def1 Aug 03 13:20:18.174877 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Name: tempest-VolumesSnapshotTestJSON-443356912-project Aug 03 13:20:18.174877 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: method: > Aug 03 13:20:18.174877 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: exception: Instance 5038bf7d-256b-4252-a7c0-a7cd89bab16a could not be found. Aug 03 13:20:18.174877 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: action_args: {'id': '5038bf7d-256b-4252-a7c0-a7cd89bab16a'} Aug 03 13:20:18.175942 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:20:18.175942 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:20:18.175942 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:20:18.175942 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:20:18.175942 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:20:18.175942 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:20:18.175942 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:20:18.175942 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:20:18.175942 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:20:18.175942 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:20:18.175942 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5038bf7d-256b-4252-a7c0-a7cd89bab16a could not be found. Aug 03 13:20:18.175942 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:20:18.175942 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:20:18.175942 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:20:18.175942 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:20:18.175942 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:20:18.175942 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:20:18.175942 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:20:18.175942 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:20:18.175942 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:20:18.177682 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:20:18.177682 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:20:18.177682 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:20:18.177682 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:20:18.177682 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:20:18.177682 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:20:18.177682 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:20:18.177682 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5038bf7d-256b-4252-a7c0-a7cd89bab16a could not be found. Aug 03 13:20:18.177682 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:20:18.177682 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:20:18.177682 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:20:18.177682 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:20:18.177682 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:20:18.177682 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:20:18.177682 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:20:18.177682 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:20:18.177682 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5038bf7d-256b-4252-a7c0-a7cd89bab16a could not be found. Aug 03 13:20:18.177682 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:20:18.179217 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-284d2f8d-ab79-4116-9b6c-f961cb552c5f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Returning 404 to user: Instance 5038bf7d-256b-4252-a7c0-a7cd89bab16a could not be found. {{(pid=119410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:20:18.179217 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-284d2f8d-ab79-4116-9b6c-f961cb552c5f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a" status: 404 len: 111 microversion: 2.1 time: 0.029767 Aug 03 13:20:18.179217 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 657/1319] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:20:18 2022] GET /compute/v2.1/servers/5038bf7d-256b-4252-a7c0-a7cd89bab16a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:20:28.505572 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-d61fc839-10df-4f43-a5dc-d9c4084d5607 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-486848861", "imageRef": "c0aabcc0-d4af-4f0e-b8a5-d140344fce1f", "flavorRef": "452", "networks": [{"uuid": "5f37e0cc-1a98-46de-b43f-53aa1adab767"}]}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:20:28.514678 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:20:28.515465 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:20:28.559768 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.network.neutron [None req-d61fc839-10df-4f43-a5dc-d9c4084d5607 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] validate_networks() for [('5f37e0cc-1a98-46de-b43f-53aa1adab767', None, None, None, None, None)] {{(pid=119409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 13:20:28.954455 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-d61fc839-10df-4f43-a5dc-d9c4084d5607 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Flavor limits 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 13:20:28.954912 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-d61fc839-10df-4f43-a5dc-d9c4084d5607 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Image limits 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 13:20:28.955428 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-d61fc839-10df-4f43-a5dc-d9c4084d5607 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Flavor pref 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 13:20:28.955831 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-d61fc839-10df-4f43-a5dc-d9c4084d5607 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Image pref 0:0:0 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 13:20:28.956235 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.virt.hardware [None req-d61fc839-10df-4f43-a5dc-d9c4084d5607 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 13:20:28.965417 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d61fc839-10df-4f43-a5dc-d9c4084d5607 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:28.965798 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d61fc839-10df-4f43-a5dc-d9c4084d5607 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:28.966586 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d61fc839-10df-4f43-a5dc-d9c4084d5607 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:28.967048 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-d61fc839-10df-4f43-a5dc-d9c4084d5607 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:28.984547 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-d61fc839-10df-4f43-a5dc-d9c4084d5607 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Getting quotas for project dcdb85a0e97a498ba3c84801d5a87c61. Resources: {'instances', 'ram', 'cores'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 13:20:28.988453 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.quota [None req-d61fc839-10df-4f43-a5dc-d9c4084d5607 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Getting quotas for user 66011efd111b4472992ad4c66963def1 and project dcdb85a0e97a498ba3c84801d5a87c61. Resources: {'instances', 'ram', 'cores'} {{(pid=119409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 13:20:28.999186 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-d61fc839-10df-4f43-a5dc-d9c4084d5607 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Going to run 1 instances... {{(pid=119409) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 13:20:29.001349 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-d61fc839-10df-4f43-a5dc-d9c4084d5607 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 3b909cee-a56e-496f-bb43-557c9c18713b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0aabcc0-d4af-4f0e-b8a5-d140344fce1f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 13:20:29.118437 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-d61fc839-10df-4f43-a5dc-d9c4084d5607 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.616598 Aug 03 13:20:29.119095 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 663/1320] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 3 13:20:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 13:20:29.129820 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-884b1986-529c-4c5c-80ed-5b1dd704334e tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:20:29.130431 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-884b1986-529c-4c5c-80ed-5b1dd704334e tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 3b909cee-a56e-496f-bb43-557c9c18713b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:20:29.132816 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=8 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:20:29.133472 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:20:29.188590 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-884b1986-529c-4c5c-80ed-5b1dd704334e tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66011efd111b4472992ad4c66963def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdb85a0e97a498ba3c84801d5a87c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:20:29.195841 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-884b1986-529c-4c5c-80ed-5b1dd704334e tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b" status: 200 len: 1218 microversion: 2.1 time: 0.069779 Aug 03 13:20:29.198173 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 658/1321] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:20:29 2022] GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:20:30.233650 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-40a6a99e-6f6e-47f0-b0fb-57828fa8937a tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:20:30.234277 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-40a6a99e-6f6e-47f0-b0fb-57828fa8937a tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 3b909cee-a56e-496f-bb43-557c9c18713b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:20:30.240522 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-40a6a99e-6f6e-47f0-b0fb-57828fa8937a tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:30.240974 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-40a6a99e-6f6e-47f0-b0fb-57828fa8937a tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:30.241762 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-40a6a99e-6f6e-47f0-b0fb-57828fa8937a tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:30.242831 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-40a6a99e-6f6e-47f0-b0fb-57828fa8937a tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:30.302136 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-40a6a99e-6f6e-47f0-b0fb-57828fa8937a tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66011efd111b4472992ad4c66963def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdb85a0e97a498ba3c84801d5a87c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:20:30.310250 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-40a6a99e-6f6e-47f0-b0fb-57828fa8937a tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b" status: 200 len: 1214 microversion: 2.1 time: 0.080959 Aug 03 13:20:30.310840 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 664/1322] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:20:30 2022] GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:20:31.332012 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-e28cccf8-6675-4337-b12f-0721dcf4f913 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:20:31.332624 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-e28cccf8-6675-4337-b12f-0721dcf4f913 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 3b909cee-a56e-496f-bb43-557c9c18713b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:20:31.340932 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e28cccf8-6675-4337-b12f-0721dcf4f913 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:31.341396 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e28cccf8-6675-4337-b12f-0721dcf4f913 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:31.342252 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e28cccf8-6675-4337-b12f-0721dcf4f913 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:31.342699 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-e28cccf8-6675-4337-b12f-0721dcf4f913 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:31.404892 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-e28cccf8-6675-4337-b12f-0721dcf4f913 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66011efd111b4472992ad4c66963def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdb85a0e97a498ba3c84801d5a87c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:20:31.412799 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-e28cccf8-6675-4337-b12f-0721dcf4f913 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b" status: 200 len: 1276 microversion: 2.1 time: 0.086498 Aug 03 13:20:31.413408 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 659/1323] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:20:31 2022] GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b => generated 1276 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:20:32.433464 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-4e3e30ec-094c-4054-b757-8556d3042261 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:20:32.434107 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-4e3e30ec-094c-4054-b757-8556d3042261 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 3b909cee-a56e-496f-bb43-557c9c18713b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:20:32.440692 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4e3e30ec-094c-4054-b757-8556d3042261 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:32.441138 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4e3e30ec-094c-4054-b757-8556d3042261 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:32.441894 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4e3e30ec-094c-4054-b757-8556d3042261 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:32.442326 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-4e3e30ec-094c-4054-b757-8556d3042261 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:32.577145 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-4e3e30ec-094c-4054-b757-8556d3042261 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66011efd111b4472992ad4c66963def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdb85a0e97a498ba3c84801d5a87c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:20:32.584824 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-4e3e30ec-094c-4054-b757-8556d3042261 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b" status: 200 len: 1318 microversion: 2.1 time: 0.155310 Aug 03 13:20:32.585381 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 665/1324] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:20:32 2022] GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:20:32.624975 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-c37b793b-2cae-4885-aed2-c57be6cbbebe req-c3ed0833-e357-4ba4-93d8-4c20da49db68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b909cee-a56e-496f-bb43-557c9c18713b", "tag": "785dc515-604e-43e6-9407-95178ac6427c"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:20:32.634647 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-c37b793b-2cae-4885-aed2-c57be6cbbebe req-c3ed0833-e357-4ba4-93d8-4c20da49db68 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:32.635114 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-c37b793b-2cae-4885-aed2-c57be6cbbebe req-c3ed0833-e357-4ba4-93d8-4c20da49db68 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:32.645936 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-c37b793b-2cae-4885-aed2-c57be6cbbebe req-c3ed0833-e357-4ba4-93d8-4c20da49db68 service nova] Creating event network-changed:785dc515-604e-43e6-9407-95178ac6427c for instance 3b909cee-a56e-496f-bb43-557c9c18713b on hv-cinder-85083 Aug 03 13:20:32.651398 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-c37b793b-2cae-4885-aed2-c57be6cbbebe req-c3ed0833-e357-4ba4-93d8-4c20da49db68 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030150 Aug 03 13:20:32.652145 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 660/1325] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:20:33.605589 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-ee631ab2-b755-4db6-89f2-c190856e6859 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:20:33.606212 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-ee631ab2-b755-4db6-89f2-c190856e6859 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 3b909cee-a56e-496f-bb43-557c9c18713b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:20:33.612592 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ee631ab2-b755-4db6-89f2-c190856e6859 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:33.613028 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ee631ab2-b755-4db6-89f2-c190856e6859 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:33.613805 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ee631ab2-b755-4db6-89f2-c190856e6859 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:33.614230 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-ee631ab2-b755-4db6-89f2-c190856e6859 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:33.744113 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-ee631ab2-b755-4db6-89f2-c190856e6859 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66011efd111b4472992ad4c66963def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdb85a0e97a498ba3c84801d5a87c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:20:33.751757 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-ee631ab2-b755-4db6-89f2-c190856e6859 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b" status: 200 len: 1318 microversion: 2.1 time: 0.149971 Aug 03 13:20:33.752311 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 666/1326] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:20:33 2022] GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:20:34.774288 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-82e64211-dfa9-47b8-b0bd-fe15712edc56 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:20:34.775027 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-82e64211-dfa9-47b8-b0bd-fe15712edc56 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 3b909cee-a56e-496f-bb43-557c9c18713b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:20:34.781183 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-82e64211-dfa9-47b8-b0bd-fe15712edc56 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:34.781630 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-82e64211-dfa9-47b8-b0bd-fe15712edc56 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:34.782646 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-82e64211-dfa9-47b8-b0bd-fe15712edc56 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:34.783108 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-82e64211-dfa9-47b8-b0bd-fe15712edc56 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:34.914330 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-82e64211-dfa9-47b8-b0bd-fe15712edc56 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66011efd111b4472992ad4c66963def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdb85a0e97a498ba3c84801d5a87c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:20:34.921712 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-82e64211-dfa9-47b8-b0bd-fe15712edc56 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b" status: 200 len: 1318 microversion: 2.1 time: 0.152367 Aug 03 13:20:34.922278 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 661/1327] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:20:34 2022] GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:20:35.941476 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-17c157bc-cbb4-4d3c-803f-f641e2fe387b tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:20:35.942076 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-17c157bc-cbb4-4d3c-803f-f641e2fe387b tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 3b909cee-a56e-496f-bb43-557c9c18713b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:20:35.949325 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-17c157bc-cbb4-4d3c-803f-f641e2fe387b tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:35.949769 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-17c157bc-cbb4-4d3c-803f-f641e2fe387b tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:35.950521 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-17c157bc-cbb4-4d3c-803f-f641e2fe387b tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:35.950976 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-17c157bc-cbb4-4d3c-803f-f641e2fe387b tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:36.082053 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-17c157bc-cbb4-4d3c-803f-f641e2fe387b tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66011efd111b4472992ad4c66963def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdb85a0e97a498ba3c84801d5a87c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:20:36.089622 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-17c157bc-cbb4-4d3c-803f-f641e2fe387b tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b" status: 200 len: 1318 microversion: 2.1 time: 0.151981 Aug 03 13:20:36.090654 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 667/1328] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:20:35 2022] GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:20:37.111400 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-d9c4b96a-588c-4aa2-bdf8-05b89e8a9273 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:20:37.112083 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-d9c4b96a-588c-4aa2-bdf8-05b89e8a9273 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 3b909cee-a56e-496f-bb43-557c9c18713b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:20:37.119728 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d9c4b96a-588c-4aa2-bdf8-05b89e8a9273 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:37.120211 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d9c4b96a-588c-4aa2-bdf8-05b89e8a9273 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:37.120965 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d9c4b96a-588c-4aa2-bdf8-05b89e8a9273 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:37.121470 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-d9c4b96a-588c-4aa2-bdf8-05b89e8a9273 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:37.249467 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-d9c4b96a-588c-4aa2-bdf8-05b89e8a9273 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66011efd111b4472992ad4c66963def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdb85a0e97a498ba3c84801d5a87c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:20:37.256811 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-d9c4b96a-588c-4aa2-bdf8-05b89e8a9273 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b" status: 200 len: 1318 microversion: 2.1 time: 0.149662 Aug 03 13:20:37.257946 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 662/1329] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:20:37 2022] GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:20:38.278541 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-520c39a1-a2c6-467b-9d4b-e87746e266e9 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:20:38.279224 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-520c39a1-a2c6-467b-9d4b-e87746e266e9 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 3b909cee-a56e-496f-bb43-557c9c18713b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:20:38.285839 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-520c39a1-a2c6-467b-9d4b-e87746e266e9 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:38.286294 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-520c39a1-a2c6-467b-9d4b-e87746e266e9 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:38.287089 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-520c39a1-a2c6-467b-9d4b-e87746e266e9 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:38.287525 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-520c39a1-a2c6-467b-9d4b-e87746e266e9 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:38.418296 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-520c39a1-a2c6-467b-9d4b-e87746e266e9 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66011efd111b4472992ad4c66963def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdb85a0e97a498ba3c84801d5a87c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:20:38.425743 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-520c39a1-a2c6-467b-9d4b-e87746e266e9 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b" status: 200 len: 1318 microversion: 2.1 time: 0.150991 Aug 03 13:20:38.426287 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 668/1330] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:20:38 2022] GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:20:38.490277 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [req-95d66022-9e6f-4ef4-8fa5-e1f02bf279b0 req-c69759b0-33fd-42da-ba1c-c3818ae7bda2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b909cee-a56e-496f-bb43-557c9c18713b", "name": "network-vif-plugged", "status": "completed", "tag": "785dc515-604e-43e6-9407-95178ac6427c"}]} {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:20:38.500667 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-95d66022-9e6f-4ef4-8fa5-e1f02bf279b0 req-c69759b0-33fd-42da-ba1c-c3818ae7bda2 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:38.501128 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [req-95d66022-9e6f-4ef4-8fa5-e1f02bf279b0 req-c69759b0-33fd-42da-ba1c-c3818ae7bda2 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:38.514172 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.compute.server_external_events [req-95d66022-9e6f-4ef4-8fa5-e1f02bf279b0 req-c69759b0-33fd-42da-ba1c-c3818ae7bda2 service nova] Creating event network-vif-plugged:785dc515-604e-43e6-9407-95178ac6427c for instance 3b909cee-a56e-496f-bb43-557c9c18713b on hv-cinder-85083 Aug 03 13:20:38.519495 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [req-95d66022-9e6f-4ef4-8fa5-e1f02bf279b0 req-c69759b0-33fd-42da-ba1c-c3818ae7bda2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033020 Aug 03 13:20:38.524063 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 663/1331] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:20:39.447125 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-7763a046-ab5a-4d67-98ae-53f1b9143f97 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:20:39.447745 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-7763a046-ab5a-4d67-98ae-53f1b9143f97 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 3b909cee-a56e-496f-bb43-557c9c18713b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:20:39.449619 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell0:SELECT=2 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:20:39.450356 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell0:SELECT=6 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:20:39.455652 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7763a046-ab5a-4d67-98ae-53f1b9143f97 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:39.456097 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7763a046-ab5a-4d67-98ae-53f1b9143f97 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:39.456852 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7763a046-ab5a-4d67-98ae-53f1b9143f97 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:39.457285 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-7763a046-ab5a-4d67-98ae-53f1b9143f97 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:39.587987 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-7763a046-ab5a-4d67-98ae-53f1b9143f97 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66011efd111b4472992ad4c66963def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdb85a0e97a498ba3c84801d5a87c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:20:39.595353 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-7763a046-ab5a-4d67-98ae-53f1b9143f97 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b" status: 200 len: 1318 microversion: 2.1 time: 0.152064 Aug 03 13:20:39.595912 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 669/1332] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:20:39 2022] GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:20:40.617263 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-c5f53713-5575-4f76-bafc-fce545886149 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:20:40.617961 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-c5f53713-5575-4f76-bafc-fce545886149 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 3b909cee-a56e-496f-bb43-557c9c18713b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:20:40.620030 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell0:SELECT=2 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:20:40.625473 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c5f53713-5575-4f76-bafc-fce545886149 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:40.625921 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c5f53713-5575-4f76-bafc-fce545886149 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:40.626680 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c5f53713-5575-4f76-bafc-fce545886149 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:40.627145 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-c5f53713-5575-4f76-bafc-fce545886149 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:40.767769 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-c5f53713-5575-4f76-bafc-fce545886149 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66011efd111b4472992ad4c66963def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdb85a0e97a498ba3c84801d5a87c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:20:40.775844 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-c5f53713-5575-4f76-bafc-fce545886149 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b" status: 200 len: 1507 microversion: 2.1 time: 0.162938 Aug 03 13:20:40.776396 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 664/1333] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:20:40 2022] GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:20:40.796108 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-71659253-33a5-486d-b2e4-eff570285172 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9781b884-d743-4d83-8811-50f34363f123", "device": "/dev/sdb"}} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:20:40.798553 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-71659253-33a5-486d-b2e4-eff570285172 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 3b909cee-a56e-496f-bb43-557c9c18713b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:20:40.805081 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-71659253-33a5-486d-b2e4-eff570285172 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:40.805515 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-71659253-33a5-486d-b2e4-eff570285172 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:40.806261 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-71659253-33a5-486d-b2e4-eff570285172 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:20:40.806721 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-71659253-33a5-486d-b2e4-eff570285172 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:20:41.508612 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-71659253-33a5-486d-b2e4-eff570285172 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "POST /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.716213 Aug 03 13:20:41.509247 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 670/1334] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Aug 3 13:20:40 2022] POST /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b/os-volume_attachments => generated 194 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:21:03.467334 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-02d3ef57-2ef2-46cf-be5c-75de6d03efd3 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:21:03.467829 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-02d3ef57-2ef2-46cf-be5c-75de6d03efd3 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 3b909cee-a56e-496f-bb43-557c9c18713b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:21:03.469955 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_api:SELECT=16 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:21:03.470791 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG dbcounter [-] [119410] Writing DB stats nova_cell1:SELECT=28 {{(pid=119410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:21:03.475353 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-02d3ef57-2ef2-46cf-be5c-75de6d03efd3 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:21:03.475844 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-02d3ef57-2ef2-46cf-be5c-75de6d03efd3 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:21:03.476625 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-02d3ef57-2ef2-46cf-be5c-75de6d03efd3 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:21:03.482323 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-02d3ef57-2ef2-46cf-be5c-75de6d03efd3 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:21:03.557923 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.objects.instance [None req-02d3ef57-2ef2-46cf-be5c-75de6d03efd3 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lazy-loading 'services' on Instance uuid 3b909cee-a56e-496f-bb43-557c9c18713b {{(pid=119410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 13:21:03.777873 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-02d3ef57-2ef2-46cf-be5c-75de6d03efd3 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "DELETE /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b/os-volume_attachments/9781b884-d743-4d83-8811-50f34363f123" status: 202 len: 0 microversion: 2.1 time: 0.314307 Aug 03 13:21:03.778560 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 665/1335] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Aug 3 13:21:03 2022] DELETE /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b/os-volume_attachments/9781b884-d743-4d83-8811-50f34363f123 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 13:21:04.902375 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:21:04.903229 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG dbcounter [-] [119409] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:21:04.907146 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-37760f8a-116a-4566-90ef-a4723654b110 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:21:04.907737 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-37760f8a-116a-4566-90ef-a4723654b110 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 3b909cee-a56e-496f-bb43-557c9c18713b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:21:04.915023 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-37760f8a-116a-4566-90ef-a4723654b110 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:21:04.915474 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-37760f8a-116a-4566-90ef-a4723654b110 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:21:04.916230 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-37760f8a-116a-4566-90ef-a4723654b110 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:21:04.916664 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-37760f8a-116a-4566-90ef-a4723654b110 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:21:04.940634 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-37760f8a-116a-4566-90ef-a4723654b110 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 3b909cee-a56e-496f-bb43-557c9c18713b] Going to try to terminate instance {{(pid=119409) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 13:21:05.269716 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-37760f8a-116a-4566-90ef-a4723654b110 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "DELETE /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b" status: 204 len: 0 microversion: 2.1 time: 0.368626 Aug 03 13:21:05.272365 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 671/1336] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 3 13:21:04 2022] DELETE /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 13:21:05.280340 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-79d4508a-b252-4a8f-918d-24d2a54b34cc tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:21:05.281044 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-79d4508a-b252-4a8f-918d-24d2a54b34cc tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 3b909cee-a56e-496f-bb43-557c9c18713b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:21:05.287570 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-79d4508a-b252-4a8f-918d-24d2a54b34cc tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:21:05.288020 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-79d4508a-b252-4a8f-918d-24d2a54b34cc tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:21:05.288781 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-79d4508a-b252-4a8f-918d-24d2a54b34cc tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:21:05.289214 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-79d4508a-b252-4a8f-918d-24d2a54b34cc tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:21:05.417952 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-79d4508a-b252-4a8f-918d-24d2a54b34cc tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66011efd111b4472992ad4c66963def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdb85a0e97a498ba3c84801d5a87c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:21:05.425347 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-79d4508a-b252-4a8f-918d-24d2a54b34cc tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b" status: 200 len: 1513 microversion: 2.1 time: 0.149808 Aug 03 13:21:05.425907 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 666/1337] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:21:05 2022] GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:21:06.447090 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [None req-481c94bb-71f2-4548-bbd1-4933615d0965 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:21:06.447792 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.compute.api [None req-481c94bb-71f2-4548-bbd1-4933615d0965 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 3b909cee-a56e-496f-bb43-557c9c18713b] Fetching instance by UUID {{(pid=119409) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:21:06.454302 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-481c94bb-71f2-4548-bbd1-4933615d0965 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:21:06.454755 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-481c94bb-71f2-4548-bbd1-4933615d0965 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:21:06.455542 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-481c94bb-71f2-4548-bbd1-4933615d0965 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:21:06.455980 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [None req-481c94bb-71f2-4548-bbd1-4933615d0965 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:21:06.586891 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.policy [None req-481c94bb-71f2-4548-bbd1-4933615d0965 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66011efd111b4472992ad4c66963def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdb85a0e97a498ba3c84801d5a87c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119409) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:21:06.594292 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [None req-481c94bb-71f2-4548-bbd1-4933615d0965 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b" status: 200 len: 1513 microversion: 2.1 time: 0.152117 Aug 03 13:21:06.594874 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 672/1338] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:21:06 2022] GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:21:07.615208 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-fe4b33f0-4b72-4865-a2b9-3e2c5b8f8f7f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:21:07.616007 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-fe4b33f0-4b72-4865-a2b9-3e2c5b8f8f7f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 3b909cee-a56e-496f-bb43-557c9c18713b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:21:07.629671 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fe4b33f0-4b72-4865-a2b9-3e2c5b8f8f7f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:21:07.634345 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fe4b33f0-4b72-4865-a2b9-3e2c5b8f8f7f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:21:07.634345 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fe4b33f0-4b72-4865-a2b9-3e2c5b8f8f7f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:21:07.634345 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-fe4b33f0-4b72-4865-a2b9-3e2c5b8f8f7f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:21:07.684761 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG nova.api.openstack.wsgi [req-7edbd338-f59a-4702-95a4-443ea2295118 req-04fa21cb-b4cc-43fd-b9e3-5d1600476018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b909cee-a56e-496f-bb43-557c9c18713b", "name": "network-vif-deleted", "tag": "785dc515-604e-43e6-9407-95178ac6427c"}]} {{(pid=119409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 13:21:07.695460 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-7edbd338-f59a-4702-95a4-443ea2295118 req-04fa21cb-b4cc-43fd-b9e3-5d1600476018 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:21:07.695946 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: DEBUG oslo_concurrency.lockutils [req-7edbd338-f59a-4702-95a4-443ea2295118 req-04fa21cb-b4cc-43fd-b9e3-5d1600476018 service nova] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:21:07.696110 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.policy [None req-fe4b33f0-4b72-4865-a2b9-3e2c5b8f8f7f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66011efd111b4472992ad4c66963def1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdb85a0e97a498ba3c84801d5a87c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119410) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 13:21:07.703824 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-fe4b33f0-4b72-4865-a2b9-3e2c5b8f8f7f tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b" status: 200 len: 1471 microversion: 2.1 time: 0.092497 Aug 03 13:21:07.704402 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 667/1339] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:21:07 2022] GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b => generated 1471 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 13:21:07.709987 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.compute.server_external_events [req-7edbd338-f59a-4702-95a4-443ea2295118 req-04fa21cb-b4cc-43fd-b9e3-5d1600476018 service nova] Creating event network-vif-deleted:785dc515-604e-43e6-9407-95178ac6427c for instance 3b909cee-a56e-496f-bb43-557c9c18713b on hv-cinder-85083 Aug 03 13:21:07.715162 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO nova.api.openstack.requestlog [req-7edbd338-f59a-4702-95a4-443ea2295118 req-04fa21cb-b4cc-43fd-b9e3-5d1600476018 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034096 Aug 03 13:21:07.715762 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: [pid: 119409|app: 0|req: 673/1340] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 3 13:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 13:21:08.724440 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-53c483c4-ca65-402e-b6e4-0c06accf6a40 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Calling method '>' {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 13:21:08.725049 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.compute.api [None req-53c483c4-ca65-402e-b6e4-0c06accf6a40 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] [instance: 3b909cee-a56e-496f-bb43-557c9c18713b] Fetching instance by UUID {{(pid=119410) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 13:21:08.732407 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-53c483c4-ca65-402e-b6e4-0c06accf6a40 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:21:08.732866 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-53c483c4-ca65-402e-b6e4-0c06accf6a40 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:21:08.733636 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-53c483c4-ca65-402e-b6e4-0c06accf6a40 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 13:21:08.734082 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG oslo_concurrency.lockutils [None req-53c483c4-ca65-402e-b6e4-0c06accf6a40 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Lock "d7258eba-25ec-4b0b-9efc-0af1d93beccb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 13:21:08.747510 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.wsgi [None req-53c483c4-ca65-402e-b6e4-0c06accf6a40 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] HTTP exception thrown: Instance 3b909cee-a56e-496f-bb43-557c9c18713b could not be found. Aug 03 13:21:08.749148 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-53c483c4-ca65-402e-b6e4-0c06accf6a40 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Request method failure captured: Aug 03 13:21:08.749148 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: request: GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b HTTP/1.1 Aug 03 13:21:08.749148 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept: application/json Aug 03 13:21:08.749148 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Accept-Encoding: identity Aug 03 13:21:08.749148 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Connection: close Aug 03 13:21:08.749148 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Length: 0 Aug 03 13:21:08.749148 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Content-Type: application/json Aug 03 13:21:08.749148 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Host: 10.222.0.64 Aug 03 13:21:08.749148 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Openstack-System-Scope: None Aug 03 13:21:08.749148 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: User-Agent: python-urllib3/1.26.10 Aug 03 13:21:08.749148 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Auth-Token: gAAAAABi6nXKpcEzXJCUiyvGIHAhzfvCFtBts-ZGlQXWfieSojSR4hzUgLNB5PfOBC2OidQ69kTIQf0SuvN3rzYJk1tbWpBbGv0MWngyDvbY8PNOxZ4Jv4DwmTzNZC6riBrndhkXwYYWNfFgYXrQaHzxDKhZDFjvHVht0NPOV8oGl7y5yEf3HNE Aug 03 13:21:08.749148 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Id: None Aug 03 13:21:08.749148 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Domain-Name: None Aug 03 13:21:08.749148 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Identity-Status: Confirmed Aug 03 13:21:08.749148 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Is-Admin-Project: True Aug 03 13:21:08.749148 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Id: default Aug 03 13:21:08.749148 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Domain-Name: Default Aug 03 13:21:08.749148 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Id: dcdb85a0e97a498ba3c84801d5a87c61 Aug 03 13:21:08.749148 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Project-Name: tempest-VolumesSnapshotTestJSON-443356912 Aug 03 13:21:08.749148 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Role: member,reader Aug 03 13:21:08.749148 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Roles: member,reader Aug 03 13:21:08.750996 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/dcdb85a0e97a498ba3c84801d5a87c61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/dcdb85a0e97a498ba3c84801d5a87c61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/dcdb85a0e97a498ba3c84801d5a87c61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_dcdb85a0e97a498ba3c84801d5a87c61", "adminURL": "http://10.222.0.64:8080"}]}] Aug 03 13:21:08.750996 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant: tempest-VolumesSnapshotTestJSON-443356912 Aug 03 13:21:08.750996 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Id: dcdb85a0e97a498ba3c84801d5a87c61 Aug 03 13:21:08.750996 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-443356912 Aug 03 13:21:08.750996 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User: tempest-VolumesSnapshotTestJSON-443356912-project Aug 03 13:21:08.750996 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Id: default Aug 03 13:21:08.750996 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Domain-Name: Default Aug 03 13:21:08.750996 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Id: 66011efd111b4472992ad4c66963def1 Aug 03 13:21:08.750996 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: X-User-Name: tempest-VolumesSnapshotTestJSON-443356912-project Aug 03 13:21:08.750996 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: method: > Aug 03 13:21:08.750996 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: exception: Instance 3b909cee-a56e-496f-bb43-557c9c18713b could not be found. Aug 03 13:21:08.750996 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: action_args: {'id': '3b909cee-a56e-496f-bb43-557c9c18713b'} Aug 03 13:21:08.751903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: {{(pid=119410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 13:21:08.751903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:21:08.751903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 13:21:08.751903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 13:21:08.751903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 13:21:08.751903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 13:21:08.751903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 13:21:08.751903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 13:21:08.751903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 13:21:08.751903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 13:21:08.751903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b909cee-a56e-496f-bb43-557c9c18713b could not be found. Aug 03 13:21:08.751903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:21:08.751903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:21:08.751903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:21:08.751903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:21:08.751903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:21:08.751903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:21:08.751903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 13:21:08.751903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 13:21:08.751903 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 13:21:08.753908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 13:21:08.753908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 13:21:08.753908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 13:21:08.753908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 13:21:08.753908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 13:21:08.753908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 13:21:08.753908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 13:21:08.753908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b909cee-a56e-496f-bb43-557c9c18713b could not be found. Aug 03 13:21:08.753908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:21:08.753908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 13:21:08.753908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:21:08.753908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 13:21:08.753908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 13:21:08.753908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 13:21:08.753908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 13:21:08.753908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 13:21:08.753908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b909cee-a56e-496f-bb43-557c9c18713b could not be found. Aug 03 13:21:08.753908 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: ERROR nova.api.openstack.wsgi Aug 03 13:21:08.756105 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: DEBUG nova.api.openstack.wsgi [None req-53c483c4-ca65-402e-b6e4-0c06accf6a40 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] Returning 404 to user: Instance 3b909cee-a56e-496f-bb43-557c9c18713b could not be found. {{(pid=119410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 13:21:08.756105 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO nova.api.openstack.requestlog [None req-53c483c4-ca65-402e-b6e4-0c06accf6a40 tempest-VolumesSnapshotTestJSON-443356912 tempest-VolumesSnapshotTestJSON-443356912-project] 10.222.0.64 "GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b" status: 404 len: 111 microversion: 2.1 time: 0.030156 Aug 03 13:21:08.756105 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: [pid: 119410|app: 0|req: 668/1341] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 3 13:21:08 2022] GET /compute/v2.1/servers/3b909cee-a56e-496f-bb43-557c9c18713b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 13:22:57.468069 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 13:22:57.468669 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Wed Aug 3 13:22:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 13:23:00.477603 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 13:23:00.478368 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Wed Aug 3 13:23:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 13:24:27.908359 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 13:24:27.908993 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Wed Aug 3 13:24:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 13:24:41.055434 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 13:24:41.056123 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Wed Aug 3 13:24:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 13:26:17.476054 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 13:26:17.476537 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Wed Aug 3 13:26:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 13:26:20.486698 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 13:26:20.487406 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Wed Aug 3 13:26:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 13:26:34.848520 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 13:26:34.849172 dv-cinder-850836-4-iscsi devstack@n-api.service[119409]: Wed Aug 3 13:26:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 13:26:35.136764 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 13:26:35.137328 dv-cinder-850836-4-iscsi devstack@n-api.service[119410]: Wed Aug 3 13:26:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!